[
https://issues.apache.org/jira/browse/MAPREDUCE-4256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396894#comment-13396894
]
Robert Joseph Evans commented on MAPREDUCE-4256:
------------------------------------------------
I agree with you that we should start off with something simple. I have no
idea if we even want to implement everything that I had in the list. I
personally think that we do not want to, but I also want us to fully think
about the problem so we don't paint ourselves into a corner.
Your initial ideas seem very reasonable to me. I think the big thing here is
coordinating with what others are trying to do in this area already.
Andrew Ferguson under MAPREDUCE-4351 is trying to make Container Monitoring
Pluggable. It looks like we are trying to split up container monitoring and
make it pluggable, so we need work that out.
Arun is also pushing forward with adding in CPU as a resource under
MAPREDUCE-4334.
> Improve resource scheduling
> ---------------------------
>
> Key: MAPREDUCE-4256
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4256
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: resourcemanager
> Reporter: Radim Kolar
>
> Currently resource manager supports only Memory resource during container
> allocation.
> I propose following improvements:
> 1. add support for CPU utilization. Node CPU used information can be obtained
> by ResourceCalculatorPlugin.
> 2. add support for custom resources. In node configuration will be something
> like:
> name=node.resource.GPU, value=1 (node has 1 GPU).
> If job will need to use GPU for computation, it will add "GPU=1" requirement
> to its job config and Resource Manager will allocate container on node with
> GPU available.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
