zhihai xu created YARN-4979: ------------------------------- Summary: FSAppAttempt adds duplicate ResourceRequest to demand in updateDemand. Key: YARN-4979 URL: https://issues.apache.org/jira/browse/YARN-4979 Project: Hadoop YARN Issue Type: Bug Components: fairscheduler Affects Versions: 2.7.2, 2.8.0 Reporter: zhihai xu Assignee: zhihai xu
FSAppAttempt adds duplicate ResourceRequest to demand in updateDemand. We should only count ResourceRequest for ResourceRequest.ANY when calculate demand. Because {{hasContainerForNode}} will return false if no container request for ResourceRequest.ANY and both {{allocateNodeLocal}} and {{allocateRackLocal}} will also decrease the number of containers for ResourceRequest.ANY. This issue may cause current memory demand overflow(integer) because duplicate requests can be on multiple nodes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)