Hi Tobias, Currently, I do not use bundle any dependency into my application jar. I will try that. Thanks a lot!
Bill On Tue, Jul 8, 2014 at 5:22 PM, Tobias Pfeiffer <t...@preferred.jp> wrote: > Bill, > > have you packaged "org.apache.spark" % "spark-streaming-kafka_2.10" % > "1.0.0" into your application jar? If I remember correctly, it's not > bundled with the downloadable compiled version of Spark. > > Tobias > > > On Wed, Jul 9, 2014 at 8:18 AM, Bill Jay <bill.jaypeter...@gmail.com> > wrote: > >> Hi all, >> >> I used sbt to package a code that uses spark-streaming-kafka. The >> packaging succeeded. However, when I submitted to yarn, the job ran for 10 >> seconds and there was an error in the log file as follows: >> >> Caused by: java.lang.NoClassDefFoundError: >> org/apache/spark/streaming/kafka/KafkaUtils$ >> >> >> Does anyone know the reason for this? Thanks! >> >> >> Bill >> > >
