[
https://issues.apache.org/jira/browse/SPARK-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14482414#comment-14482414
]
Kostas Sakellis commented on SPARK-6506:
----------------------------------------
I ran into this issue too by running:
bq. spark-submit --master yarn-cluster examples/pi.py 4
it looks like I only had to set: spark.yarn.appMasterEnv.SPARK_HOME=/bogus to
get it going:
bq. spark-submit --conf spark.yarn.appMasterEnv.SPARK_HOME=/bogus --master
yarn-cluster pi.py 4
> python support yarn cluster mode requires SPARK_HOME to be set
> --------------------------------------------------------------
>
> Key: SPARK-6506
> URL: https://issues.apache.org/jira/browse/SPARK-6506
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.3.0
> Reporter: Thomas Graves
>
> We added support for python running in yarn cluster mode in
> https://issues.apache.org/jira/browse/SPARK-5173, but it requires that
> SPARK_HOME be set in the environment variables for application master and
> executor. It doesn't have to be set to anything real but it fails if its not
> set. See the command at the end of: https://github.com/apache/spark/pull/3976
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
