Re: Re: How to pass env variables from master to executors within spark-shell

2014-08-20 Thread Zhanfeng Huo
((key, value) <- sysProps) { System.setProperty(key, value) } Best Regards Zhanfeng Huo From: Akhil Das Date: 2014-08-21 14:36 To: Darin McBeath CC: Spark User Group Subject: Re: How to pass env variables from master to executors within spark-shell One approach would be to set these environmen

Re: How to pass env variables from master to executors within spark-shell

2014-08-20 Thread Akhil Das
One approach would be to set these environment variables inside the spark-env.sh in all workers then you can access them using the System.getEnv("WHATEVER") Thanks Best Regards On Wed, Aug 20, 2014 at 9:49 PM, Darin McBeath wrote: > Can't seem to figure this out. I've tried several different