IIUC for example you want to set environment FOO=bar in executor side, you could use "spark.executor.Env.FOO=bar" in conf file, AM will pick this configuration and set as environment variable through container launching. Just list all the envs you want to set in executor side like spark.executor.xxx=xxx.
Thanks Saisai On Thu, Feb 18, 2016 at 3:31 AM, Lin Zhao <l...@exabeam.com> wrote: > I've been trying to set some environment variables for the spark executors > but haven't had much like. I tried editting conf/spark-env.sh but it > doesn't get through to the executors. I'm running 1.6.0 and yarn, any > pointer is appreciated. > > Thanks, > Lin >
