[
https://issues.apache.org/jira/browse/MAPREDUCE-715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12727858#action_12727858
]
Matei Zaharia commented on MAPREDUCE-715:
-----------------------------------------
Here's an example expanding on the description. Today, a config file might look
as follows
{code}
<?xml version="1.0"?>
<allocations>
<pool name="ads">
<maxRunningJobs>100</maxRunningJobs>
<minSharePreemptionTimeout>300</minSharePreemptionTimeout>
</pool>
<user name="matei">
<maxRunningJobs>5</maxRunningJobs>
</user>
<poolMaxJobsDefault>20</poolMaxJobsDefault>
<userMaxJobsDefault>10</userMaxJobsDefault>
<defaultMinSharePreemptionTimeout>600</defaultMinSharePreemptionTimeout>
</allocations>
{code}
It would be more usable to set them in "poolDefaults" and "userDefaults"
elements as follows:
{code}
<?xml version="1.0"?>
<allocations>
<pool name="ads">
<maxRunningJobs>100</maxRunningJobs>
<minSharePreemptionTimeout>300</minSharePreemptionTimeout>
</pool>
<user name="matei">
<maxRunningJobs>5</maxRunningJobs>
</user>
<poolDefaults>
<maxRunningJobs>20</maxRunningJobs>
<minSharePreemptionTimeout>600</minSharePreemptionTimeout>
</poolDefaults>
<userDefaults>
<maxRunningJobs>10</maxRunningJobs>
</user>
</allocations>
{code}
> Allow pool and user default settings to be set through poolDefaults and
> userDefaults elements
> ---------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-715
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-715
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/fair-share
> Reporter: Matei Zaharia
>
> Over time a number of elements have been added to the fair scheduler config
> file for setting default running job limits, preemption timeouts, etc for
> pools and for users. Right now these are all set in top-level elements in the
> allocations file, such as <userMaxJobsDefault>. It would be easier to
> understand if there was a <userDefaults> element that contained defaults for
> all pools (using the same element names as <user> elements, e.g.
> <maxRunningJobs> in this case), and similarly, a <poolDefaults> element for
> pool defaults.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
