[ https://issues.apache.org/jira/browse/YARN-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16085184#comment-16085184 ]
Arun Suresh edited comment on YARN-6808 at 7/13/17 5:03 AM: ------------------------------------------------------------ [~haibochen], the plan is to use it to provide stricter guaranteed-capacity to apps, at the same time allow for preemption to be lazily performed at the NM. I guess YARN-1015 / YARN-1013 can be viewed as something complementary. My understanding is that in the later case, the scheduler would allocate OPP containers to a specific node based on unused allocated resources. While, with this patch, OPP containers will be allocated if an app requests resources beyond its available headroom. was (Author: asuresh): [~haibochen], the plan to use it to provide stricter capacity guarantees to queue, essentially push preemption to the NM. I guess YARN-1015 / YARN-1013 can be viewed as something complementary. My understanding is that in the later case, the scheduler would allocate OPP containers to a specific node based on unused allocated resources. While, with this patch, OPP containers will be allocated if an app requests resources beyond its available headroom. > Allow Schedulers to return OPPORTUNISTIC containers when queues go over > configured capacity > ------------------------------------------------------------------------------------------- > > Key: YARN-6808 > URL: https://issues.apache.org/jira/browse/YARN-6808 > Project: Hadoop YARN > Issue Type: New Feature > Reporter: Arun Suresh > Assignee: Arun Suresh > Attachments: YARN-6808.001.patch > > > This is based on discussions with [~kasha] and [~kkaranasos]. > Currently, when a Queues goes over capacity, apps on starved queues must wait > either for containers to complete or for them to be pre-empted by the > scheduler to get resources. > This JIRA proposes to allow Schedulers to: > # Allocate all containers over the configured queue capacity/weight as > OPPORTUNISTIC. > # Auto-promote running OPPORTUNISTIC containers of apps as and when their > GUARANTEED containers complete. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org