Re: Setting YARN executors' JAVA_HOME

2016-08-18 Thread Ryan Williams
Ah, I guess I missed that by only looking in the YARN config docs, but this is a more general parameter and not documented there. Thanks! On Thu, Aug 18, 2016 at 2:51 PM dhruve ashar wrote: > Hi Ryan, > > You can get more info on this here: Spark documentation >

Re: Setting YARN executors' JAVA_HOME

2016-08-18 Thread dhruve ashar
Hi Ryan, You can get more info on this here: Spark documentation . The page addresses what you need. You can look for spark.executorEnv.[EnvironmentVariableName] and set your java home as spark.executorEnv.JAVA_HOME= Regards, Dhruve

Setting YARN executors' JAVA_HOME

2016-08-18 Thread Ryan Williams
I need to tell YARN a JAVA_HOME to use when spawning containers (to run a Java 8 app on Java 7 YARN). The only way I've found that works is setting SPARK_YARN_USER_ENV="JAVA_HOME=/path/to/java8". The code