[
https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13766650#comment-13766650
]
Bikas Saha commented on YARN-1197:
----------------------------------
bq. 1) We can incrementally send resource request with small resources like
before, until we get enough resources in total
bq. 2) Merge resource in the same node, make only one big container in each node
When the RM is asked for a container then this is what the RM does. It
incrementally adds reserved space on a node until it can allocate the full
resources desired by the container. Then it assigns the container to the app.
So its not clear how making small allocations and then merging them in the app
is going to help.
By asking the RM directly for 10G resources we can ensure that the RM will
eventually give us that. If we ask for 10 1G resources then we are not
guaranteed that the RM will give them to us on the same node and thus the
overall request may be unsatisfiable.
> Add container merge support in YARN
> -----------------------------------
>
> Key: YARN-1197
> URL: https://issues.apache.org/jira/browse/YARN-1197
> Project: Hadoop YARN
> Issue Type: Task
> Components: api, nodemanager, resourcemanager
> Affects Versions: 2.1.0-beta
> Reporter: Wangda Tan
>
> Currently, YARN cannot support merge several containers in one node to a big
> container, which can make us incrementally ask resources, merge them to a
> bigger one, and launch our processes. The user scenario is described in the
> comments.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
