iPhone
-- --
??: Todd Nist
: 2015??05??24?? 02:14
??: yana.kadiyska
: user@spark.apache.org
: Re: spark.executor.extraClassPath - Values not picked up by executors
Hi Yana,
Yes typeo in the eamil, file name is correct "spark-defaults.conf"; thanks
though. So it a
Hi Yana,
Yes typeo in the eamil, file name is correct "spark-defaults.conf"; thanks
though. So it appears to work if in the driver is specify it as part of
the sparkConf:
val conf = new SparkConf().setAppName(getClass.getSimpleName)
.set("spark.executor.extraClassPath",
"/projects/spark-cassan
Todd, I don't have any answers for you...other than the file is actually
named spark-defaults.conf (not sure if you made a typo in the email or
misnamed the file...). Do any other options from that file get read?
I also wanted to ask if you built the spark-cassandra-connector-assembly-1.3
.0-SNAPS
I'm using the spark-cassandra-connector from DataStax in a spark streaming
job launched from my own driver. It is connecting a a standalone cluster
on my local box which has two worker running.
This is Spark 1.3.1 and spark-cassandra-connector-1.3.0-SNAPSHOT. I have
added the following entry to