Hi All,
When we upgrade our existing samza job from 0.9 to 0.10, we found this
error below:
/var/lib/hadoop-yarn/data/samza-yarn/usercache/yuanchi/appcache/application_1458330755534_0075/container_1458330755534_0075_02_000001/__package/bin/run-class.sh:
line 63: OpenJDK: command not found
java version "1.7.0_95"
OpenJDK Runtime Environment (IcedTea 2.6.4) (7u95-2.6.4-0ubuntu0.12.04.1)
OpenJDK 64-Bit Server VM (build 24.95-b01, mixed mode)
Exception in thread "main" java.lang.NullPointerException
at java.io.StringReader.<init>(StringReader.java:50)
at
org.codehaus.jackson.JsonFactory.createJsonParser(JsonFactory.java:636)
at
org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1863)
at
org.apache.samza.job.yarn.SamzaAppMaster$.main(SamzaAppMaster.scala:71)
at org.apache.samza.job.yarn.SamzaAppMaster.main(SamzaAppMaster.scala)
And that line 71 in SamzaAppMaster is:
val coordinatorSystemConfig = new
MapConfig(SamzaObjectMapper.getObjectMapper.readValue(System.getenv(ShellCommandConfig.ENV_COORDINATOR_SYSTEM_CONFIG),
classOf[Config]))
And our checkpoint/ new version related properties are as below:
##################### Job config #####################
job.factory.class=org.apache.samza.job.yarn.YarnJobFactory
job.name=trip-counter
job.datacenter=sjc1
job.environment=sandbox
job.coordinator.system=kafka
job.coordinator.replication.factor=3
##################### Task config #####################
task.class=com.uber.athena.TripCounterTask
task.inputs=kafka.trip_details,kafka.hp-api-client_signups
task.outputTripTopic=trip_count_details
task.outputClientSignUpsTopic=client_sign_ups_count_details
task.checkpoint.factory=org.apache.samza.checkpoint.kafka.KafkaCheckpointManagerFactory
task.checkpoint.system=kafka
task.checkpoint.replication.factor=3
Plus our version for codehaus jackson dependencies is 1.9.13 as
suggested in other dev email threads.
Any ideas what would cause this issue?
Thanks!
Yuanchi
--
Yuanchi Ning
