Janus Chow created YARN-10835:
---------------------------------
Summary: Pass user defined variables of
yarn.nodemanager.env-whitelist along jobs
Key: YARN-10835
URL: https://issues.apache.org/jira/browse/YARN-10835
Project: Hadoop YARN
Issue Type: Improvement
Reporter: Janus Chow
The configuration of "yarn.nodemanager.env-whitelist" has been helpful in
running multi version Hadoop on Yarn. But the pain point is that users need to
use different configurations to run jobs of different versions of Hadoop.
The first idea is to have SRE prepared different versions of configurations and
let users specify different environment variables of "HADOOP_CONF_DIR", this
shifts the burden from users to SRE that they have to maintain different
versions of configurations with only one or two configurations changed.
This ticket proposes to export the value of the environment variable in
"yarn.nodemanager.env-whitelist" via the environment variable or Java
properties of the client submitting jobs. So that SRE only has to maintain one
version of configuration and users can easily define Hadoop version with one
export in an environment variable or Java property.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
