[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Payne updated YARN-4945: ----------------------------- Attachment: Intra-Queue Preemption Use Cases.pdf [~sunilg] and [~leftnoteasy], I am attaching the set of use cases that I could think of for in-queue preemption. I will include the base use-case statements in this comment, but please do look at the document for details, examples, and open issues for each use case. 1. Ensure each user in a queue is guaranteed its appropriate minimum-user-limit-percent 1.1. When one (or more) user(s) are below their minimun-user-limit-percent and one (or more) user(s) are above their minimum-user-limit-percent, resources will be preempted after a configurable time period from the user(s) which are above their minimum-user-limit-percent. 1.2. When two (or more) users are below their minimum-user-limit-factor, neither will be preempted in favor of the other. 1.3. If all users in a queue are at or over their minimum-user-limit-percent, the user-limit-percent-preemption policy will not preempt resources. 2. Ensure priority inversion doesn’t occur between applications. 2.1. When a lower priority app is consuming long-running resources, a higher priority app is requesting resources, and the queue cannot grow to accommodate the higher priority app’s request, the priority-intra-queue-preemption policy will preempt resources from the lower priority app, after a configurable period of time. 3. Interaction between the priority and minimum-user-limit-percent preemption policies. 3.1. If priority inversion occurs between apps owned by different users, the priority preemption policy will not preempt containers from the lower priority app if it would cause the lower priority app to go below the user’s minimum-user-limit-percent guarantee. > [Umbrella] Capacity Scheduler Preemption Within a queue > ------------------------------------------------------- > > Key: YARN-4945 > URL: https://issues.apache.org/jira/browse/YARN-4945 > Project: Hadoop YARN > Issue Type: Bug > Reporter: Wangda Tan > Attachments: Intra-Queue Preemption Use Cases.pdf, > IntraQueuepreemption-CapacityScheduler (Design).pdf, YARN-2009-wip.patch > > > This is umbrella ticket to track efforts of preemption within a queue to > support features like: > YARN-2009. YARN-2113. YARN-4781. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org