I think the only way to pass on environment variables to worker node is to write it in spark-env.sh file on each worker node.
On Sun, Aug 23, 2015 at 8:16 PM, Hemant Bhanawat <hemant9...@gmail.com> wrote: > Check for spark.driver.extraJavaOptions and > spark.executor.extraJavaOptions in the following article. I think you can > use -D to pass system vars: > > spark.apache.org/docs/latest/configuration.html#runtime-environment > Hi, > > I am starting a spark streaming job in standalone mode with spark-submit. > > Is there a way to make the UNIX environment variables with which > spark-submit is started available to the processes started on the worker > nodes? > > Jan > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
