Re: spark-shell does not see conf folder content on emr-4

2015-09-07 Thread Akhil Das
You can also create a link to /etc/spark/conf from /usr/lib/spark/ Thanks Best Regards On Fri, Sep 4, 2015 at 2:40 AM, Alexander Pivovarov wrote: > Hi Everyone > > My question is specific to running spark-1.4.1 on emr-4.0.0 > > spark installed to /usr/lib/spark > conf

spark-shell does not see conf folder content on emr-4

2015-09-03 Thread Alexander Pivovarov
Hi Everyone My question is specific to running spark-1.4.1 on emr-4.0.0 spark installed to /usr/lib/spark conf folder linked to /etc/spark/conf spark-shell location /usr/bin/spark-shell I noticed that if I run spark-shell it does not read /etc/spark/conf folder files (e.g. spark-env.sh and