Repository: spark Updated Branches: refs/heads/master d0a5c32bd -> 96fb894d4
[SPARK-2930] clarify docs on using webhdfs with spark.yarn.access.nam⦠â¦enodes Author: Tom Graves <tgra...@yahoo-inc.com> Closes #10699 from tgravescs/SPARK-2930. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/96fb894d Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/96fb894d Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/96fb894d Branch: refs/heads/master Commit: 96fb894d4b33e293625fa92bbeccbbf5e688015e Parents: d0a5c32 Author: Tom Graves <tgra...@yahoo-inc.com> Authored: Fri Jan 15 13:11:27 2016 +0000 Committer: Sean Owen <so...@cloudera.com> Committed: Fri Jan 15 13:11:27 2016 +0000 ---------------------------------------------------------------------- docs/running-on-yarn.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/96fb894d/docs/running-on-yarn.md ---------------------------------------------------------------------- diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 06413f8..a148c86 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -260,10 +260,10 @@ If you need a reference to the proper location to put log files in the YARN so t <td>(none)</td> <td> A comma-separated list of secure HDFS namenodes your Spark application is going to access. For - example, <code>spark.yarn.access.namenodes=hdfs://nn1.com:8032,hdfs://nn2.com:8032</code>. - The Spark application must have access to the namenodes listed and Kerberos must - be properly configured to be able to access them (either in the same realm or in - a trusted realm). Spark acquires security tokens for each of the namenodes so that + example, <code>spark.yarn.access.namenodes=hdfs://nn1.com:8032,hdfs://nn2.com:8032, + webhdfs://nn3.com:50070</code>. The Spark application must have access to the namenodes listed + and Kerberos must be properly configured to be able to access them (either in the same realm + or in a trusted realm). Spark acquires security tokens for each of the namenodes so that the Spark application can access those remote HDFS clusters. </td> </tr> --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org