[
https://issues.apache.org/jira/browse/SPARK-20995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
guoxiaolongzte updated SPARK-20995:
-----------------------------------
Description:
Ensure that HADOOP_CONF_DIR or YARN_CONF_DIR points to the directory which
contains the (client side) configuration files for the Hadoop cluster.
These configs are used to write to HDFS and connect to the YARN
ResourceManager. The
configuration contained in this directory will be distributed to the YARN
cluster so that all
containers used by the application use the same configuration.
Sometimes, HADOOP_CONF_DIR is set to the hdfs configuration file path. So,
YARN_CONF_DIR should be set to the yarn configuration file path.
> 'Spark-env.sh.template' should add 'YARN_CONF_DIR' configuration instructions.
> ------------------------------------------------------------------------------
>
> Key: SPARK-20995
> URL: https://issues.apache.org/jira/browse/SPARK-20995
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.1.1
> Reporter: guoxiaolongzte
> Priority: Minor
>
> Ensure that HADOOP_CONF_DIR or YARN_CONF_DIR points to the directory which
> contains the (client side) configuration files for the Hadoop cluster.
> These configs are used to write to HDFS and connect to the YARN
> ResourceManager. The
> configuration contained in this directory will be distributed to the YARN
> cluster so that all
> containers used by the application use the same configuration.
> Sometimes, HADOOP_CONF_DIR is set to the hdfs configuration file path. So,
> YARN_CONF_DIR should be set to the yarn configuration file path.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
