The properties in spark-env.sh are machine-specific. so need to specify in you worker as well. I guess you ask is the System.setproperty(). you can call it before you initialize your sparkcontext.
Best Regards, Chen Jingci On Tue, Mar 11, 2014 at 6:47 AM, Linlin <linlin200...@gmail.com> wrote: > > Hi, > > I have a java option (-Xss) setting specified in SPARK_JAVA_OPTS in > spark-env.sh, noticed after stop/restart the spark cluster, the > master/worker daemon has the setting being applied, but this setting is not > being propagated to the executor, my application continue behave the same. > I > am not sure if there is a way to specify it through SparkConf? like > SparkConf.set(), and what is the correct way of setting this up for a > particular spark application. > > Thank you! > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/SPARK-JAVA-OPTS-not-picked-up-by-the-application-tp2483.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >
