[ https://issues.apache.org/jira/browse/SPARK-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Wendell updated SPARK-2454: ----------------------------------- Assignee: Andrew Or > Separate driver spark home from executor spark home > --------------------------------------------------- > > Key: SPARK-2454 > URL: https://issues.apache.org/jira/browse/SPARK-2454 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 1.0.1 > Reporter: Andrew Or > Assignee: Andrew Or > Fix For: 1.1.0 > > > The driver may not always share the same directory structure as the > executors. It makes little sense to always re-use the driver's spark home on > the executors. > https://github.com/apache/spark/pull/1244/ is an open effort to fix this. > However, this still requires us to set SPARK_HOME on all the executor nodes. > Really we should separate this out into something like `spark.executor.home` > and `spark.driver.home` rather than re-using SPARK_HOME everywhere. -- This message was sent by Atlassian JIRA (v6.2#6252) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org