Re: Difference between spark-defaults.conf and SparkConf.set

2015-07-01 Thread yana
Original message /divdivFrom: Akhil Das ak...@sigmoidanalytics.com /divdivDate:07/01/2015 2:27 AM (GMT-05:00) /divdivTo: Yana Kadiyska yana.kadiy...@gmail.com /divdivCc: user@spark.apache.org /divdivSubject: Re: Difference between spark-defaults.conf and SparkConf.set /divdiv

Re: Difference between spark-defaults.conf and SparkConf.set

2015-07-01 Thread Akhil Das
.addJar works for me when i run it as a stand-alone application (without using spark-submit) Thanks Best Regards On Tue, Jun 30, 2015 at 7:47 PM, Yana Kadiyska yana.kadiy...@gmail.com wrote: Hi folks, running into a pretty strange issue: I'm setting spark.executor.extraClassPath

Difference between spark-defaults.conf and SparkConf.set

2015-06-30 Thread Yana Kadiyska
Hi folks, running into a pretty strange issue: I'm setting spark.executor.extraClassPath spark.driver.extraClassPath to point to some external JARs. If I set them in spark-defaults.conf everything works perfectly. However, if I remove spark-defaults.conf and just create a SparkConf and call