[ https://issues.apache.org/jira/browse/YARN-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16443268#comment-16443268 ]
Konstantinos Karanasos commented on YARN-8178: ---------------------------------------------- This sounds interesting, [~Zian Chen]! I am curious to learn more details, especially about when exactly demotion will kick in and which containers will be chosen for demotion. > [Umbrella] Resource Over-commitment Based on Opportunistic Container > Preemption > ------------------------------------------------------------------------------- > > Key: YARN-8178 > URL: https://issues.apache.org/jira/browse/YARN-8178 > Project: Hadoop YARN > Issue Type: New Feature > Components: capacity scheduler > Reporter: Zian Chen > Priority: Major > > We want to provide an opportunistic container-based solution to achieve more > aggressive preemption with shorter preemption monitoring interval. > Instead of allowing applications to allocate resources with a mix of > guaranteed and opportunistic containers, we allow newly submitted > applications to only contain guaranteed containers. Meanwhile, we change the > preemption logic to, instead of killing containers, demote guaranteed > containers into opportunistic ones, so that when there are new applications > submitted, we can ensure that these containers can be launched by preempting > opportunistic containers. > This approach is related to YARN-1011 but achieves over-commitment in a > different way. However, we rely on opportunistic container part implemented > in YARN-1011 to make our design work well. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org