[
https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682811#comment-16682811
]
Sunil Govindan commented on YARN-9007:
--------------------------------------
Thanks [~Tao Yang].
Few high level thoughts.
# IMO, ExecutionType.OPPORTUNISTIC containers could be the first candidates
for any preemption. Rather than selecting GUARANTEED containers before
consuming OPPORTUNISTIC seems not best choice as per me.
# On the flip side, i know OPPORTUNISTIC containers has a different lifecycle
when more demand comes on the node. But to me, both preemption and existing
model of upgrading/downgrading ExecutionType need to coexist together. So could
we discuss more on that line.
in either of above case, we need more discussion.
Mean time could you pls explain it more how this existing patch helps in below
cases.
# when we have OPPORTUNISTIC and GUARANTEED containers in list of possible
containers to preempt, what will happen if
## GUARANTEED containers are not enough to meet the demand of higher priority
apps or similar kind
## after consuming all selected GUARANTEED for preemption, what ll happen to
OPPORTUNISTIC containers which are left?
> CS preemption monitor should only select GUARANTEED containers as candidates
> ----------------------------------------------------------------------------
>
> Key: YARN-9007
> URL: https://issues.apache.org/jira/browse/YARN-9007
> Project: Hadoop YARN
> Issue Type: Bug
> Components: capacityscheduler
> Affects Versions: 3.2.1
> Reporter: Tao Yang
> Assignee: Tao Yang
> Priority: Major
> Attachments: YARN-9007.001.patch
>
>
> Currently CS preemption monitor doesn't consider execution type of
> containers, so OPPORTUNISTIC containers maybe selected and killed without
> effect.
> In some scenario with OPPORTUNISTIC containers, not even preemption can't
> work properly to balance resources, but also some apps with OPPORTUNISTIC
> containers maybe effected and unable to work.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
