[
https://issues.apache.org/jira/browse/MAPREDUCE-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Ferguson updated MAPREDUCE-4327:
---------------------------------------
Attachment: MAPREDUCE-4327-v3.patch
This is an updated version of my previous patch. Of particular note, it fixes a
typo in the original patch in Resources' subtractFrom() -- the original patch
double-subtracted memory.
I have successfully run MapReduce jobs using this patch, and they will request
both memory and cpu cores. So far, I have only tested this with the FIFO
scheduler.
When combined with MAPREDUCE-4351 and MAPREDUCE-4334, the requested cpu share
is also enforced.
One discussion point I want to raise is: currently the number of requested
cores is an integer. Do we want to support fractional cores as well?
> Enhance CS to schedule accounting for both memory and cpu cores
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-4327
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4327
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: mrv2, resourcemanager, scheduler
> Affects Versions: 2.0.0-alpha
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Attachments: MAPREDUCE-4327-v2.patch, MAPREDUCE-4327-v3.patch,
> MAPREDUCE-4327.patch
>
>
> With YARN being a general purpose system, it would be useful for several
> applications (MPI et al) to specify not just memory but also CPU (cores) for
> their resource requirements. Thus, it would be useful to the
> CapacityScheduler to account for both.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
