Yufei Gu created YARN-8061:
------------------------------
Summary: An application may preempt itself in case of minshare
preemption
Key: YARN-8061
URL: https://issues.apache.org/jira/browse/YARN-8061
Project: Hadoop YARN
Issue Type: Bug
Components: fairscheduler
Affects Versions: 3.0.0, 2.8.3, 2.9.0
Reporter: Yufei Gu
Assignee: Yufei Gu
Assume a leaf queue A's minshare is 10G memory and fairshare is 12G. It used
4G, so its minshare-staved resources is 6G and will be distributed to all its
apps. Assume there are 4 apps a1, a2, a3, a4 inside, who demand 3G, 2G, 1G, and
0.5G. a1 gets 3G minshare-starved resources, a2 gets 2G, a3 get 1G, they are
all considered as starved apps except a4 who doesn't get any.
An app can preempt another under the same queue due to minshare starvation. For
example, a1 can preempt a4 if a4 uses more resources than its fair share, which
is 3G(12G/4). If a1 itself used more than 3G memory, it will preempt itself! I
will create a unit test later.
The solution would check application's fair share while distributing minshare
starvation, more details in method {{FSLeafQueue#updateStarvedAppsMinshare()}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
