Bill, have you packaged "org.apache.spark" % "spark-streaming-kafka_2.10" % "1.0.0" into your application jar? If I remember correctly, it's not bundled with the downloadable compiled version of Spark.
Tobias On Wed, Jul 9, 2014 at 8:18 AM, Bill Jay <[email protected]> wrote: > Hi all, > > I used sbt to package a code that uses spark-streaming-kafka. The > packaging succeeded. However, when I submitted to yarn, the job ran for 10 > seconds and there was an error in the log file as follows: > > Caused by: java.lang.NoClassDefFoundError: > org/apache/spark/streaming/kafka/KafkaUtils$ > > > Does anyone know the reason for this? Thanks! > > > Bill >
