[ https://issues.apache.org/jira/browse/YARN-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16235857#comment-16235857 ]
Sunil G commented on YARN-7424: ------------------------------- Thanks [~eepayne] for detailed analysis. {{"yarn.resourcemanager.monitor.capacity.preemption.intra-queue-preemption.minimum-threshold"}} could be configured to start intra queue preemption on a queue. But yes, this is generic in all queues. {{max-allowable-limit}} helps only to control preemption in a given round of preemption calculation. This could be configured to a very low value so that only few resource will be preempted in such cases. Now the solution which you mentioned will help to control preemption. In a cluster where we have free space and some users who are over MULP, i think we can restrict such users to raise demand for preemption. In which preemption mode, this will be added ? will it be common for both ? > Capacity Scheduler Intra-queue preemption: add property to only preempt up to > configured MULP > --------------------------------------------------------------------------------------------- > > Key: YARN-7424 > URL: https://issues.apache.org/jira/browse/YARN-7424 > Project: Hadoop YARN > Issue Type: Improvement > Components: capacity scheduler, scheduler preemption > Affects Versions: 3.0.0-beta1, 2.8.2 > Reporter: Eric Payne > Assignee: Eric Payne > Priority: Major > > If the queue's configured minimum user limit percent (MULP) is something > small like 1%, all users will max out well over their MULP until 100 users > have apps in the queue. Since the intra-queue preemption monitor tries to > balance the resource among the users, most of the time in this use case it > will be preempting containers on behalf of users that are already over their > MULP guarantee. > This JIRA proposes that a property should be provided so that a queue can be > configured to only preempt on behalf of a user until that user has reached > its MULP. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org