[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Fix Version/s: (was: YARN-5881) 3.1.0 > UI and metrics changes related to absolute resource configuration > - > > Key: YARN-7254 > URL: https://issues.apache.org/jira/browse/YARN-7254 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacity scheduler >Reporter: Sunil G >Assignee: Sunil G > Fix For: 3.1.0 > > Attachments: YARN-7254.001.patch, YARN-7254.002.patch, > YARN-7254.YARN-5881.002.patch, YARN-7254.YARN-5881.003.patch, > YARN-7254.YARN-5881.004.patch, YARN-7254.YARN-5881.005.patch, > YARN-7254.YARN-5881.006.patch, YARN-7254.YARN-5881.007.patch, > YARN-7254.YARN-5881.008.patch, YARN-7254.YARN-5881.009.patch > > > Impact on UI and metrics related to absolute resource configuration on CS -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7254: - Fix Version/s: YARN-5881 > UI and metrics changes related to absolute resource configuration > - > > Key: YARN-7254 > URL: https://issues.apache.org/jira/browse/YARN-7254 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacity scheduler >Reporter: Sunil G >Assignee: Sunil G > Fix For: YARN-5881 > > Attachments: YARN-7254.001.patch, YARN-7254.002.patch, > YARN-7254.YARN-5881.002.patch, YARN-7254.YARN-5881.003.patch, > YARN-7254.YARN-5881.004.patch, YARN-7254.YARN-5881.005.patch, > YARN-7254.YARN-5881.006.patch, YARN-7254.YARN-5881.007.patch, > YARN-7254.YARN-5881.008.patch, YARN-7254.YARN-5881.009.patch > > > Impact on UI and metrics related to absolute resource configuration on CS -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.009.patch Fixing findbugs > UI and metrics changes related to absolute resource configuration > - > > Key: YARN-7254 > URL: https://issues.apache.org/jira/browse/YARN-7254 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacity scheduler >Reporter: Sunil G >Assignee: Sunil G > Attachments: YARN-7254.001.patch, YARN-7254.002.patch, > YARN-7254.YARN-5881.002.patch, YARN-7254.YARN-5881.003.patch, > YARN-7254.YARN-5881.004.patch, YARN-7254.YARN-5881.005.patch, > YARN-7254.YARN-5881.006.patch, YARN-7254.YARN-5881.007.patch, > YARN-7254.YARN-5881.008.patch, YARN-7254.YARN-5881.009.patch > > > Impact on UI and metrics related to absolute resource configuration on CS -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.008.patch one more test case correction. updating v8 patch. > UI and metrics changes related to absolute resource configuration > - > > Key: YARN-7254 > URL: https://issues.apache.org/jira/browse/YARN-7254 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacity scheduler >Reporter: Sunil G >Assignee: Sunil G > Attachments: YARN-7254.001.patch, YARN-7254.002.patch, > YARN-7254.YARN-5881.002.patch, YARN-7254.YARN-5881.003.patch, > YARN-7254.YARN-5881.004.patch, YARN-7254.YARN-5881.005.patch, > YARN-7254.YARN-5881.006.patch, YARN-7254.YARN-5881.007.patch, > YARN-7254.YARN-5881.008.patch > > > Impact on UI and metrics related to absolute resource configuration on CS -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.007.patch Several test cases are failing and its been tracked in YARN-7324 and YARN-7270. Other than that, testHeadroomWithMaxCap is fixed in this patch. > UI and metrics changes related to absolute resource configuration > - > > Key: YARN-7254 > URL: https://issues.apache.org/jira/browse/YARN-7254 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacity scheduler >Reporter: Sunil G >Assignee: Sunil G > Attachments: YARN-7254.001.patch, YARN-7254.002.patch, > YARN-7254.YARN-5881.002.patch, YARN-7254.YARN-5881.003.patch, > YARN-7254.YARN-5881.004.patch, YARN-7254.YARN-5881.005.patch, > YARN-7254.YARN-5881.006.patch, YARN-7254.YARN-5881.007.patch > > > Impact on UI and metrics related to absolute resource configuration on CS -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.006.patch Updating v6 patch after fixing javadoc and findbugs. Some test case failures are known. I will wait for one more jenkins run to verify test case failures > UI and metrics changes related to absolute resource configuration > - > > Key: YARN-7254 > URL: https://issues.apache.org/jira/browse/YARN-7254 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacity scheduler >Reporter: Sunil G >Assignee: Sunil G > Attachments: YARN-7254.001.patch, YARN-7254.002.patch, > YARN-7254.YARN-5881.002.patch, YARN-7254.YARN-5881.003.patch, > YARN-7254.YARN-5881.004.patch, YARN-7254.YARN-5881.005.patch, > YARN-7254.YARN-5881.006.patch > > > Impact on UI and metrics related to absolute resource configuration on CS -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.005.patch YARN-5881 branch is rebased. Re attaching the patch run jenkins again with minimal checkstyle fixes. > UI and metrics changes related to absolute resource configuration > - > > Key: YARN-7254 > URL: https://issues.apache.org/jira/browse/YARN-7254 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacity scheduler >Reporter: Sunil G >Assignee: Sunil G > Attachments: YARN-7254.001.patch, YARN-7254.002.patch, > YARN-7254.YARN-5881.002.patch, YARN-7254.YARN-5881.003.patch, > YARN-7254.YARN-5881.004.patch, YARN-7254.YARN-5881.005.patch > > > Impact on UI and metrics related to absolute resource configuration on CS -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.004.patch Attaching v4 patch after fixing [~leftnoteasy] comments. Thank you. I will be rebasing this branch by this week. > UI and metrics changes related to absolute resource configuration > - > > Key: YARN-7254 > URL: https://issues.apache.org/jira/browse/YARN-7254 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacity scheduler >Reporter: Sunil G >Assignee: Sunil G > Attachments: YARN-7254.001.patch, YARN-7254.002.patch, > YARN-7254.YARN-5881.002.patch, YARN-7254.YARN-5881.003.patch, > YARN-7254.YARN-5881.004.patch > > > Impact on UI and metrics related to absolute resource configuration on CS -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.003.patch Almost fixed the mentioned comments. Updating a patch. bq.REST API (should we add -mb suffix to memory as well? And change vCores to vcores) In {{org.apache.hadoop.yarn.server.resourcemanager.webapp.dao.ResourceInfo }}, we have *toString* defined as {code} @Override public String toString() { return ""; } {code} If we change this, it will impact REST o/p for all metrics etc from RM. I think a backward compatibility issue is there if we do this. bq.Configured Capacity: (100.0%) (Should this be vcore=8?). Configured was 8GB and 8 Cores and cluster capacity was 5.8GB and 12 cores. Since this value is lesser when we try with Default Calculator, *effectiveMinRatio* is kicking in and reducing the whole res down. > UI and metrics changes related to absolute resource configuration > - > > Key: YARN-7254 > URL: https://issues.apache.org/jira/browse/YARN-7254 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacity scheduler >Reporter: Sunil G >Assignee: Sunil G > Attachments: YARN-7254.001.patch, YARN-7254.002.patch, > YARN-7254.YARN-5881.002.patch, YARN-7254.YARN-5881.003.patch > > > Impact on UI and metrics related to absolute resource configuration on CS -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7254: - Attachment: YARN-7254.YARN-5881.002.patch > UI and metrics changes related to absolute resource configuration > - > > Key: YARN-7254 > URL: https://issues.apache.org/jira/browse/YARN-7254 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacity scheduler >Reporter: Sunil G >Assignee: Sunil G > Attachments: YARN-7254.001.patch, YARN-7254.002.patch, > YARN-7254.YARN-5881.002.patch > > > Impact on UI and metrics related to absolute resource configuration on CS -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.002.patch Attaching v2 patch which covers old RM UI as well. cc/[~leftnoteasy] > UI and metrics changes related to absolute resource configuration > - > > Key: YARN-7254 > URL: https://issues.apache.org/jira/browse/YARN-7254 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacity scheduler >Reporter: Sunil G >Assignee: Sunil G > Attachments: YARN-7254.001.patch, YARN-7254.002.patch > > > Impact on UI and metrics related to absolute resource configuration on CS -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.001.patch v1 patch > UI and metrics changes related to absolute resource configuration > - > > Key: YARN-7254 > URL: https://issues.apache.org/jira/browse/YARN-7254 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacity scheduler >Reporter: Sunil G >Assignee: Sunil G > Attachments: YARN-7254.001.patch > > > Impact on UI and metrics related to absolute resource configuration on CS -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org