Hi, I'm trying to run a simple Spark job that uses a 3rd party class (in this case twitter4j.Status) in the spark-shell using spark-1.0.0_SNAPSHOT
I'm starting my bin/spark-shell with the following command. ./spark-shell *--driver-class-path*"$LIBPATH/jodatime2.3/joda-convert-1.2.jar:$LIBPATH/jodatime2.3/joda-time-2.3/joda-time-2.3.jar:$LIBPATH/twitter4j-core-3.0.5.jar" *--jars* $LIBPATH/jodatime2.3/joda-convert-1.2.jar,$LIBPATH/jodatime2.3/joda-time-2.3/joda-time-2.3.jar,$LIBPATH/twitter4j-core-3.0.5.jar My code was working fine in 0.9.1 when I used the following options that were pointing to the same jar above. export SPARK_CLASSPATH export ADD_JAR Now I'm getting a NoClassDefFoundError on each of my worker nodes 14/05/05 14:03:30 INFO TaskSetManager: Loss was due to java.lang.NoClassDefFoundError: twitter4j/Status [duplicate 40] 14/05/05 14:03:30 INFO TaskSetManager: Starting task 0.0:26 as TID 73 on executor 2: *worker1.xxx.xxxx.xxxx* (NODE_LOCAL) What am I missing here? Thanks -Soumya
