[
https://issues.apache.org/jira/browse/YARN-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698925#comment-14698925
]
Srikanth Kandula commented on YARN-4056:
----------------------------------------
Will look. Possibly. However, this arch allows any bundling policy. We will
push through a couple different bundled policies. I suspect the
packer+dependencies+bounded unfairness bundled will be novel.
> Bundling: Searching for multiple containers in a single pass over {queues,
> applications, priorities}
> ----------------------------------------------------------------------------------------------------
>
> Key: YARN-4056
> URL: https://issues.apache.org/jira/browse/YARN-4056
> Project: Hadoop YARN
> Issue Type: New Feature
> Components: capacityscheduler, resourcemanager, scheduler
> Reporter: Srikanth Kandula
> Assignee: Robert Grandl
> Attachments: bundling.docx
>
>
> More than one container is allocated on many NM heartbeats. Yet, the current
> scheduler allocates exactly one container per iteration over {{queues,
> applications, priorities}}. When there are many queues, applications, or
> priorities allocating only one container per iteration can needlessly
> increase the duration of the NM heartbeat.
>
> In this JIRA, we propose bundling. That is, allow arbitrarily many containers
> to be allocated in a single iteration over {{queues, applications and
> priorities}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
