[ https://issues.apache.org/jira/browse/MAPREDUCE-4256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13284356#comment-13284356 ]
Radim Kolar commented on MAPREDUCE-4256: ---------------------------------------- resources will be detectable by plugin. Plugin will work in 2 modes (node wide and cluster wide) and report currently in use resource and max. available. If resource will not have plugin assigned, it will use simple allocation - just hardcode into hadoop config how much resources of that kind you have. > Improve resource scheduling > --------------------------- > > Key: MAPREDUCE-4256 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4256 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: resourcemanager > Reporter: Radim Kolar > > Currently resource manager supports only Memory resource during container > allocation. > I propose following improvements: > 1. add support for CPU utilization. Node CPU used information can be obtained > by ResourceCalculatorPlugin. > 2. add support for custom resources. In node configuration will be something > like: > name=node.resource.GPU, value=1 (node has 1 GPU). > If job will need to use GPU for computation, it will add "GPU=1" requirement > to its job config and Resource Manager will allocate container on node with > GPU available. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira