Re: Cluster mode dependent jars not working

2015-12-17 Thread vimal dinakaran
--driver-classpath needs to be added with jars needed. But this is not being mentioned in the spark documentation. On Tue, Dec 15, 2015 at 9:13 PM, Ted Yu wrote: > Please use --conf spark.executor.extraClassPath=XXX to specify dependent > jars. > > On Tue, Dec 15, 2015 at

Cluster mode dependent jars not working

2015-12-15 Thread vimal dinakaran
I am running spark using cluster mode for deployment . Below is the command JARS=$JARS_HOME/amqp-client-3.5.3.jar,$JARS_HOME/nscala-time_2.10-2.0.0.jar,\ $JARS_HOME/kafka_2.10-0.8.2.1.jar,$JARS_HOME/kafka-clients-0.8.2.1.jar,\ $JARS_HOME/spark-streaming-kafka_2.10-1.4.1.jar,\

Re: Cluster mode dependent jars not working

2015-12-15 Thread Ted Yu
Please use --conf spark.executor.extraClassPath=XXX to specify dependent jars. On Tue, Dec 15, 2015 at 3:57 AM, vimal dinakaran wrote: > I am running spark using cluster mode for deployment . Below is the command > > >