Provide a jobconf property for explicitly assigning a job to a pool
-------------------------------------------------------------------
Key: MAPREDUCE-707
URL: https://issues.apache.org/jira/browse/MAPREDUCE-707
Project: Hadoop Map/Reduce
Issue Type: New Feature
Components: contrib/fair-share
Reporter: Matei Zaharia
Priority: Trivial
A common use case of the fair scheduler is to have one pool per user, but then
to define some special pools for various production jobs, import jobs, etc.
Therefore, it would be nice if jobs went by default to the pool of the user who
submitted them, but there was a setting to explicitly place a job in another
pool. Today, this can be achieved through a sort of trick in the JobConf:
{code}
<property>
<name>mapred.fairscheduler.poolnameproperty</name>
<value>pool.name</value>
</property>
<property>
<name>pool.name</name>
<value>${user.name}</value>
</property>
{code}
This JIRA proposes to add a property called mapred.fairscheduler.pool that
allows a job to be placed directly into a pool, avoiding the need for this
trick.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.