[
https://issues.apache.org/jira/browse/SPARK-12956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15214406#comment-15214406
]
Thomas Graves commented on SPARK-12956:
---------------------------------------
Are you talking it uses the home directory for the spark staging directory?
If so I think this is a dup of https://issues.apache.org/jira/browse/SPARK-13063
> add spark.yarn.hdfs.home.directory property
> -------------------------------------------
>
> Key: SPARK-12956
> URL: https://issues.apache.org/jira/browse/SPARK-12956
> Project: Spark
> Issue Type: Improvement
> Components: YARN
> Affects Versions: 1.6.0
> Reporter: PJ Fanning
>
> https://github.com/apache/spark/blob/master/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala
> uses the default home directory based on the hadoop configuration. I have a
> use case where it would be useful to override this and to provide an explicit
> base path.
> If this seems like a generally use config property, I can put together a pull
> request.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
