GitHub user Astralidea opened a pull request:
https://github.com/apache/spark/pull/10770
[SPARK-12836][CORE] Fix spark enable both driver run executor & writeâ¦
⦠to HDFS
when spark set env HADOOP_USER_NAME CoarseMesosSchedulerBackend will set
sparkuser from this env, but in my cluster run spark must be root, write HDFS
must set HADOOP_USER_NAME, need a configuration set run executor by root &
write hdfs by another.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/Astralidea/spark fix-spark-12836-1
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10770.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10770
----
commit 4251d8e14af7639ca5828ad44873f943c6c8c4bf
Author: xueyan.li <xueyan...@qunar.com>
Date: 2016-01-15T10:58:22Z
[SPARK-12836][CORE] Fix spark enable both driver run executor & write to
HDFS
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
