[jira] [Commented] (YARN-2644) Recalculate headroom more frequently to keep it accurate
[ https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14161793#comment-14161793 ] Hudson commented on YARN-2644: -- FAILURE: Integrated in Hadoop-Yarn-trunk #704 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/704/]) YARN-2644. Fixed CapacityScheduler to return up-to-date headroom when AM allocates. Contributed by Craig Welch (jianhe: rev 519e5a7dd2bd540105434ec3c8939b68f6c024f8) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestApplicationLimits.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestLeafQueue.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityHeadroomProvider.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/LeafQueue.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/common/fica/FiCaSchedulerApp.java Recalculate headroom more frequently to keep it accurate Key: YARN-2644 URL: https://issues.apache.org/jira/browse/YARN-2644 Project: Hadoop YARN Issue Type: Sub-task Reporter: Craig Welch Assignee: Craig Welch Fix For: 2.6.0 Attachments: YARN-2644.11.patch, YARN-2644.14.patch, YARN-2644.15.patch, YARN-2644.15.patch See parent (1198) for more detail - this specifically covers calculating the headroom more frequently, to cover the cases where changes have occurred which impact headroom but which are not reflected due to an application not being updated. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2644) Recalculate headroom more frequently to keep it accurate
[ https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14161913#comment-14161913 ] Hudson commented on YARN-2644: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1894 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1894/]) YARN-2644. Fixed CapacityScheduler to return up-to-date headroom when AM allocates. Contributed by Craig Welch (jianhe: rev 519e5a7dd2bd540105434ec3c8939b68f6c024f8) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestApplicationLimits.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityHeadroomProvider.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestLeafQueue.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/LeafQueue.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/common/fica/FiCaSchedulerApp.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java Recalculate headroom more frequently to keep it accurate Key: YARN-2644 URL: https://issues.apache.org/jira/browse/YARN-2644 Project: Hadoop YARN Issue Type: Sub-task Reporter: Craig Welch Assignee: Craig Welch Fix For: 2.6.0 Attachments: YARN-2644.11.patch, YARN-2644.14.patch, YARN-2644.15.patch, YARN-2644.15.patch See parent (1198) for more detail - this specifically covers calculating the headroom more frequently, to cover the cases where changes have occurred which impact headroom but which are not reflected due to an application not being updated. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2644) Recalculate headroom more frequently to keep it accurate
[ https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14161970#comment-14161970 ] Hudson commented on YARN-2644: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1919 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1919/]) YARN-2644. Fixed CapacityScheduler to return up-to-date headroom when AM allocates. Contributed by Craig Welch (jianhe: rev 519e5a7dd2bd540105434ec3c8939b68f6c024f8) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/common/fica/FiCaSchedulerApp.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestLeafQueue.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestApplicationLimits.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/LeafQueue.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityHeadroomProvider.java * hadoop-yarn-project/CHANGES.txt Recalculate headroom more frequently to keep it accurate Key: YARN-2644 URL: https://issues.apache.org/jira/browse/YARN-2644 Project: Hadoop YARN Issue Type: Sub-task Reporter: Craig Welch Assignee: Craig Welch Fix For: 2.6.0 Attachments: YARN-2644.11.patch, YARN-2644.14.patch, YARN-2644.15.patch, YARN-2644.15.patch See parent (1198) for more detail - this specifically covers calculating the headroom more frequently, to cover the cases where changes have occurred which impact headroom but which are not reflected due to an application not being updated. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2644) Recalculate headroom more frequently to keep it accurate
[
https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14160492#comment-14160492
]
Hadoop QA commented on YARN-2644:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12672890/YARN-2644.14.patch
against trunk revision ed841dd.
{color:red}-1 patch{color}. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/5274//console
This message is automatically generated.
Recalculate headroom more frequently to keep it accurate
Key: YARN-2644
URL: https://issues.apache.org/jira/browse/YARN-2644
Project: Hadoop YARN
Issue Type: Sub-task
Reporter: Craig Welch
Assignee: Craig Welch
Attachments: YARN-2644.11.patch, YARN-2644.14.patch
See parent (1198) for more detail - this specifically covers calculating the
headroom more frequently, to cover the cases where changes have occurred
which impact headroom but which are not reflected due to an application not
being updated.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2644) Recalculate headroom more frequently to keep it accurate
[
https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14161148#comment-14161148
]
Hadoop QA commented on YARN-2644:
-
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12673200/YARN-2644.15.patch
against trunk revision 3affad9.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 2 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/5285//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/5285//console
This message is automatically generated.
Recalculate headroom more frequently to keep it accurate
Key: YARN-2644
URL: https://issues.apache.org/jira/browse/YARN-2644
Project: Hadoop YARN
Issue Type: Sub-task
Reporter: Craig Welch
Assignee: Craig Welch
Attachments: YARN-2644.11.patch, YARN-2644.14.patch,
YARN-2644.15.patch, YARN-2644.15.patch
See parent (1198) for more detail - this specifically covers calculating the
headroom more frequently, to cover the cases where changes have occurred
which impact headroom but which are not reflected due to an application not
being updated.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2644) Recalculate headroom more frequently to keep it accurate
[ https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14161152#comment-14161152 ] Jian He commented on YARN-2644: --- looks good, committing Recalculate headroom more frequently to keep it accurate Key: YARN-2644 URL: https://issues.apache.org/jira/browse/YARN-2644 Project: Hadoop YARN Issue Type: Sub-task Reporter: Craig Welch Assignee: Craig Welch Attachments: YARN-2644.11.patch, YARN-2644.14.patch, YARN-2644.15.patch, YARN-2644.15.patch See parent (1198) for more detail - this specifically covers calculating the headroom more frequently, to cover the cases where changes have occurred which impact headroom but which are not reflected due to an application not being updated. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2644) Recalculate headroom more frequently to keep it accurate
[ https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158689#comment-14158689 ] Jian He commented on YARN-2644: --- looks good overall. copied comment from https://issues.apache.org/jira/browse/YARN-1198?focusedCommentId=14158676page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14158676 Recalculate headroom more frequently to keep it accurate Key: YARN-2644 URL: https://issues.apache.org/jira/browse/YARN-2644 Project: Hadoop YARN Issue Type: Sub-task Reporter: Craig Welch Assignee: Craig Welch Attachments: YARN-2644.11.patch See parent (1198) for more detail - this specifically covers calculating the headroom more frequently, to cover the cases where changes have occurred which impact headroom but which are not reflected due to an application not being updated. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2644) Recalculate headroom more frequently to keep it accurate
[
https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158701#comment-14158701
]
Hadoop QA commented on YARN-2644:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12672873/YARN-2644.11.patch
against trunk revision 7f6ed7f.
{color:red}-1 patch{color}. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/5257//console
This message is automatically generated.
Recalculate headroom more frequently to keep it accurate
Key: YARN-2644
URL: https://issues.apache.org/jira/browse/YARN-2644
Project: Hadoop YARN
Issue Type: Sub-task
Reporter: Craig Welch
Assignee: Craig Welch
Attachments: YARN-2644.11.patch
See parent (1198) for more detail - this specifically covers calculating the
headroom more frequently, to cover the cases where changes have occurred
which impact headroom but which are not reflected due to an application not
being updated.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2644) Recalculate headroom more frequently to keep it accurate
[
https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158759#comment-14158759
]
Jian He commented on YARN-2644:
---
Just one more thing:
- probably we can move {{headroomProvider}} field into LeafQueue. Update
headroomProvider info in the queue itself. {{FiCaSchedulerApp}} change can be
simplified, it can get the headroomProvider via the queue Reference.
Recalculate headroom more frequently to keep it accurate
Key: YARN-2644
URL: https://issues.apache.org/jira/browse/YARN-2644
Project: Hadoop YARN
Issue Type: Sub-task
Reporter: Craig Welch
Assignee: Craig Welch
Attachments: YARN-2644.11.patch
See parent (1198) for more detail - this specifically covers calculating the
headroom more frequently, to cover the cases where changes have occurred
which impact headroom but which are not reflected due to an application not
being updated.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2644) Recalculate headroom more frequently to keep it accurate
[ https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158781#comment-14158781 ] Craig Welch commented on YARN-2644: --- Just putting our offline discussion here - the headRoomProvider has application specific info, so it can't go on the queue (the user and the required fields) Recalculate headroom more frequently to keep it accurate Key: YARN-2644 URL: https://issues.apache.org/jira/browse/YARN-2644 Project: Hadoop YARN Issue Type: Sub-task Reporter: Craig Welch Assignee: Craig Welch Attachments: YARN-2644.11.patch See parent (1198) for more detail - this specifically covers calculating the headroom more frequently, to cover the cases where changes have occurred which impact headroom but which are not reflected due to an application not being updated. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2644) Recalculate headroom more frequently to keep it accurate
[
https://issues.apache.org/jira/browse/YARN-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158826#comment-14158826
]
Hadoop QA commented on YARN-2644:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12672890/YARN-2644.14.patch
against trunk revision c8212ba.
{color:red}-1 patch{color}. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/5259//console
This message is automatically generated.
Recalculate headroom more frequently to keep it accurate
Key: YARN-2644
URL: https://issues.apache.org/jira/browse/YARN-2644
Project: Hadoop YARN
Issue Type: Sub-task
Reporter: Craig Welch
Assignee: Craig Welch
Attachments: YARN-2644.11.patch, YARN-2644.14.patch
See parent (1198) for more detail - this specifically covers calculating the
headroom more frequently, to cover the cases where changes have occurred
which impact headroom but which are not reflected due to an application not
being updated.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
