[
https://issues.apache.org/jira/browse/YARN-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16258849#comment-16258849
]
YunFan Zhou commented on YARN-7534:
-----------------------------------
[~templedf]
For example, a queue resource usage time slices as follows:
Max Resources: *<memory:10, vCores:10>*
Current used resources: *<memory:9, vCores:9>*
Pending resource request: *<memory:2, vCores:2>*
This time a node manager report the heartbeat and it has *<memory:3, vCores:3>*
available resources.
Before assigning containers it will do follows check:
{code:java}
@Override
public Resource assignContainer(FSSchedulerNode node) {
Resource assigned = Resources.none();
if (LOG.isDebugEnabled()) {
LOG.debug("Node " + node.getNodeName() + " offered to queue: " +
getName() + " fairShare: " + getFairShare());
}
if (!assignContainerPreCheck(node)) {
return assigned;
}
{code}
Because it used resources is less than maxResources. So it will assign
*<memory:2, vCores:2>* to
this queue, and in this time the queue's used resources over limit.
> Fair scheduler assign resources may exceed maxResources
> -------------------------------------------------------
>
> Key: YARN-7534
> URL: https://issues.apache.org/jira/browse/YARN-7534
> Project: Hadoop YARN
> Issue Type: Bug
> Components: fairscheduler
> Reporter: YunFan Zhou
>
> The logic we're scheduling now is to check whether the resources used by the
> queue has exceeded *maxResources* before assigning the container. This will
> leads to the fact that after assigning this container the queue uses more
> resources than *maxResources*.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
