Hi,
I'm trying to run a very simple samza task over CDH 5.0.1 YARN.
The streaming task actually does nothing... just wanted to test it before
deploying a task that uses state and generate metrics.
The task fails after 20 seconds of submitting it to YARN.
This is the task configuration:
# Job
job.factory.class=org.apache.samza.job.yarn.YarnJobFactory
job.name=foo-task
yarn.package.path=file:///home/cloudera/xxxx/xxx-streaming-1.0.0-SNAPSHOT-dist.tar.gz
# Task
task.class=fortscale.streaming.task.FooTask
task.inputs=kafka.fortscale-4769-event-score
# Serializers
serializers.registry.json.class=org.apache.samza.serializers.JsonSerdeFactory
serializers.registry.string.class=org.apache.samza.serializers.StringSerdeFactory
serializers.registry.integer.class=org.apache.samza.serializers.IntegerSerdeFactory
serializers.registry.metrics.class=org.apache.samza.serializers.MetricsSnapshotSerdeFactory
# Systems
systems.kafka.samza.factory=org.apache.samza.system.kafka.KafkaSystemFactory
systems.kafka.samza.msg.serde=string
systems.kafka.consumer.zookeeper.connect=localhost:2181
systems.kafka.consumer.auto.offset.reset=smallest
systems.kafka.producer.metadata.broker.list=localhost:9092
systems.kafka.producer.producer.type=sync
# Normally, we'd set this much higher, but we want things to look snappy in
the demo.
systems.kafka.producer.batch.num.messages=1
The only error I see in the stderr logs is that:
Null identity service, trying login service: null
Finding identity service: null
Null identity service, trying login service: null
Finding identity service: null
Exception in thread "main" java.lang.AbstractMethodError:
org.apache.hadoop.yarn.api.protocolrecords.AllocateRequest.setIncreaseRequests(Ljava/util/List;)V
at
org.apache.hadoop.yarn.api.protocolrecords.AllocateRequest.newInstance(AllocateRequest.java:81)
at
org.apache.hadoop.yarn.api.protocolrecords.AllocateRequest.newInstance(AllocateRequest.java:64)
at
org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl.allocate(AMRMClientImpl.java:237)
at
org.apache.samza.job.yarn.YarnAppMaster.run(YarnAppMaster.scala:51)
at
org.apache.samza.job.yarn.SamzaAppMaster$.main(SamzaAppMaster.scala:81)
at
org.apache.samza.job.yarn.SamzaAppMaster.main(SamzaAppMaster.scala)
Any idea what can be wrong ?
