??????spark.executor.extraClassPath - Values not picked up by executors

2015-05-23 Thread wesley.miao
iPhone -- -- ??: Todd Nist : 2015??05??24?? 02:14 ??: yana.kadiyska : user@spark.apache.org : Re: spark.executor.extraClassPath - Values not picked up by executors Hi Yana, Yes typeo in the eamil, file name is correct "spark-defaults.conf"; thanks though. So it a

Re: spark.executor.extraClassPath - Values not picked up by executors

2015-05-23 Thread Todd Nist
Hi Yana, Yes typeo in the eamil, file name is correct "spark-defaults.conf"; thanks though. So it appears to work if in the driver is specify it as part of the sparkConf: val conf = new SparkConf().setAppName(getClass.getSimpleName) .set("spark.executor.extraClassPath", "/projects/spark-cassan

Re: spark.executor.extraClassPath - Values not picked up by executors

2015-05-22 Thread Yana Kadiyska
Todd, I don't have any answers for you...other than the file is actually named spark-defaults.conf (not sure if you made a typo in the email or misnamed the file...). Do any other options from that file get read? I also wanted to ask if you built the spark-cassandra-connector-assembly-1.3 .0-SNAPS

spark.executor.extraClassPath - Values not picked up by executors

2015-05-22 Thread Todd Nist
I'm using the spark-cassandra-connector from DataStax in a spark streaming job launched from my own driver. It is connecting a a standalone cluster on my local box which has two worker running. This is Spark 1.3.1 and spark-cassandra-connector-1.3.0-SNAPSHOT. I have added the following entry to