[
https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418634#comment-16418634
]
Weiwei Yang edited comment on YARN-7497 at 3/30/18 8:25 AM:
------------------------------------------------------------
Thanks [~yangjiandan], almost there. Just one minor comments about the
description of
<property>
<description>The filesystem path for store configuration files</description>
<name>yarn.scheduler.configuration.fs.path</name>
<value>/yarn/scheduler/conf</value>
</property>
can we add more description such as:
The file system directory to store the configuration files. The path can be any
format as long as it follows hadoop compatible schema, for example value
"file:///path/to/dir" means to store the file on local file system, value
"hdfs:///path/to/dir" means to store the file on HDFS. If resource manager HA
is enabled, recommended to use hdfs schema so it works in fail-over scenario.
And the default value can be something like:
{noformat}
file://${hadoop.tmp.dir}/yarn/system/schedconf{noformat}
was (Author: cheersyang):
Thanks [~yangjiandan], almost there. Just one minor comments about the
description of
<property>
<description>The filesystem path for store configuration files</description>
<name>yarn.scheduler.configuration.fs.path</name>
<value>/yarn/scheduler/conf</value>
</property>
can we add more description such as:
The file system directory to store the configuration files. The path can be any
format as long as it follows hadoop compatible schema, for example value
"file:///path/to/dir" means to store the file on local file system, value
"hdfs:///path/to/dir" means to store the file on HDFS. If resource manager HA
is enabled, recommended to use hdfs schema so it works in fail-over scenario.
And the default value can be something like:
{noformat}
file:///tmp/yarn/schedconf/
{noformat}
Thanks
> Add FSSchedulerConfigurationStore for RM HA
> -------------------------------------------
>
> Key: YARN-7497
> URL: https://issues.apache.org/jira/browse/YARN-7497
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: yarn
> Reporter: Jiandan Yang
> Assignee: Jiandan Yang
> Priority: Major
> Attachments: YARN-7497.001.patch, YARN-7497.002.patch,
> YARN-7497.003.patch, YARN-7497.004.patch, YARN-7497.005.patch,
> YARN-7497.006.patch, YARN-7497.007.patch, YARN-7497.008.patch,
> YARN-7497.009.patch, YARN-7497.010.patch, YARN-7497.011.patch,
> YARN-7497.012.patch
>
>
> YARN-5947 add LeveldbConfigurationStore using Leveldb as backing store, but
> it does not support Yarn RM HA.
> YARN-6840 supports RM HA, but too many scheduler configurations may exceed
> znode limit, for example 10 thousand queues.
> HDFSSchedulerConfigurationStore store conf file in HDFS, when RM failover,
> new active RM can load scheduler configuration from HDFS.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
