[jira] [Comment Edited] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173358#comment-17173358 ] Muhammad Samir Khan edited comment on YARN-10390 at 8/15/20, 1:30 AM:

[jira] [Commented] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173358#comment-17173358 ] Muhammad Samir Khan commented on YARN-10390: Worth mentioning that I ran some of the tests

[jira] [Commented] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173349#comment-17173349 ] Muhammad Samir Khan commented on YARN-10390: There is a typo in the attached pdf. The base

[jira] [Created] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

Muhammad Samir Khan created YARN-10390: -- Summary: LeafQueue: retain user limits cache across assignContainers() calls Key: YARN-10390 URL: https://issues.apache.org/jira/browse/YARN-10390

[jira] [Commented] (YARN-9702) Backport YARN-5788 to branch-2.8

[ https://issues.apache.org/jira/browse/YARN-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893177#comment-16893177 ] Muhammad Samir Khan commented on YARN-9702: --- The unit tests are failing for me on branch-2.8

[jira] [Commented] (YARN-9702) Backport YARN-5788 to branch-2.8

[ https://issues.apache.org/jira/browse/YARN-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893024#comment-16893024 ] Muhammad Samir Khan commented on YARN-9702: --- The patch is from cherry-picking commit 7d2d8d25ba0

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893023#comment-16893023 ] Muhammad Samir Khan commented on YARN-9596: --- Created YARN-9702 for backporting YARN-5788 to

[jira] [Updated] (YARN-9702) Backport YARN-5788 to branch-2.8

[ https://issues.apache.org/jira/browse/YARN-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated YARN-9702: -- Attachment: YARN-9702-branch-2.8.001.patch > Backport YARN-5788 to branch-2.8 >

[jira] [Created] (YARN-9702) Backport YARN-5788 to branch-2.8

Muhammad Samir Khan created YARN-9702: - Summary: Backport YARN-5788 to branch-2.8 Key: YARN-9702 URL: https://issues.apache.org/jira/browse/YARN-9702 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892966#comment-16892966 ] Muhammad Samir Khan commented on YARN-9596: --- Also seeing the unit test failures and errors on

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892265#comment-16892265 ] Muhammad Samir Khan commented on YARN-9596: --- Posted a patch for 2.8. It also includes a

[jira] [Updated] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated YARN-9596: -- Attachment: YARN-9596-branch-2.8.005.patch > QueueMetrics has incorrect metrics when

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892191#comment-16892191 ] Muhammad Samir Khan commented on YARN-9596: --- The remaining two unit tests in

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892122#comment-16892122 ] Muhammad Samir Khan commented on YARN-9596: --- YARN-4901 fixes some of the unit test failures but

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892081#comment-16892081 ] Muhammad Samir Khan commented on YARN-9596: --- The findbugs warnings are from branch-3.0

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891957#comment-16891957 ] Muhammad Samir Khan commented on YARN-9596: --- Looking at the UT failures. > QueueMetrics has

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891432#comment-16891432 ] Muhammad Samir Khan commented on YARN-9596: --- {quote}[~eepayne] yes, the patch applies cleanly

[jira] [Updated] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated YARN-9596: -- Attachment: YARN-9596-branch-3.0.004.patch > QueueMetrics has incorrect metrics when

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890284#comment-16890284 ] Muhammad Samir Khan commented on YARN-9596: --- CSQueueUtils#updateUsedCapacity is called before

[jira] [Updated] (YARN-9671) Improve Locality Scheduling when cluster is busy

[ https://issues.apache.org/jira/browse/YARN-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated YARN-9671: -- Attachment: YARN-9671.001.patch > Improve Locality Scheduling when cluster is busy >

[jira] [Updated] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated YARN-9596: -- Attachment: YARN-9596.003.patch > QueueMetrics has incorrect metrics when labelled

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887198#comment-16887198 ] Muhammad Samir Khan commented on YARN-9596: --- Updated with changes. > QueueMetrics has incorrect

[jira] [Commented] (YARN-9671) Improve Locality Scheduling when cluster is busy

[ https://issues.apache.org/jira/browse/YARN-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885468#comment-16885468 ] Muhammad Samir Khan commented on YARN-9671: --- Edited description: will handle priority inversion

[jira] [Updated] (YARN-9671) Improve Locality Scheduling when cluster is busy

[ https://issues.apache.org/jira/browse/YARN-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated YARN-9671: -- Description: When a cluster is very busy, scheduling opportunities are few and far

[jira] [Created] (YARN-9671) Improve Locality Scheduling when cluster is busy

Muhammad Samir Khan created YARN-9671: - Summary: Improve Locality Scheduling when cluster is busy Key: YARN-9671 URL: https://issues.apache.org/jira/browse/YARN-9671 Project: Hadoop YARN

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868693#comment-16868693 ] Muhammad Samir Khan commented on YARN-9596: --- [~eepayne] yes, the patch applies cleanly with the

[jira] [Comment Edited] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868693#comment-16868693 ] Muhammad Samir Khan edited comment on YARN-9596 at 6/20/19 4:34 PM:

[jira] [Updated] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated YARN-9596: -- Affects Version/s: 3.3.0 2.8.0 > QueueMetrics has incorrect

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858834#comment-16858834 ] Muhammad Samir Khan commented on YARN-9596: --- [~Naganarasimha] [~maniraj...@gmail.com] this is

[jira] [Updated] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated YARN-9596: -- Attachment: YARN-9596.002.patch > QueueMetrics has incorrect metrics when labelled

[jira] [Assigned] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan reassigned YARN-9596: - Assignee: Muhammad Samir Khan > QueueMetrics has incorrect metrics when labelled

[jira] [Created] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

Muhammad Samir Khan created YARN-9596: - Summary: QueueMetrics has incorrect metrics when labelled partitions are involved Key: YARN-9596 URL: https://issues.apache.org/jira/browse/YARN-9596

[jira] [Updated] (YARN-6834) A container request with only racks specified and relax locality set to false is never honoured

[ https://issues.apache.org/jira/browse/YARN-6834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated YARN-6834: -- Attachment: YARN-6834.001.patch Not sure if the attached patch is the best way to solve

[jira] [Commented] (YARN-6867) AbstractYarnScheduler reports the configured maximum resources, instead of the actual, even after the configured waittime

[ https://issues.apache.org/jira/browse/YARN-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100280#comment-16100280 ] Muhammad Samir Khan commented on YARN-6867: --- The patch in YARN-4719 solves the problem. >

[jira] [Commented] (YARN-6867) AbstractYarnScheduler reports the configured maximum resources, instead of the actual, even after the configured waittime

[ https://issues.apache.org/jira/browse/YARN-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100276#comment-16100276 ] Muhammad Samir Khan commented on YARN-6867: --- Sorry, it looks like the problem was solved in trunk

[jira] [Commented] (YARN-6867) AbstractYarnScheduler reports the configured maximum resources, instead of the actual, even after the configured waittime

[ https://issues.apache.org/jira/browse/YARN-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100208#comment-16100208 ] Muhammad Samir Khan commented on YARN-6867: --- Requesting [~rkanter] and [~kasha] for comments. >

[jira] [Commented] (YARN-6867) AbstractYarnScheduler reports the configured maximum resources, instead of the actual, even after the configured waittime

[ https://issues.apache.org/jira/browse/YARN-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100193#comment-16100193 ] Muhammad Samir Khan commented on YARN-6867: --- If the application gets submitted before the wait

[jira] [Updated] (YARN-6867) AbstractYarnScheduler reports the configured maximum resources, instead of the actual, even after the configured waittime

[ https://issues.apache.org/jira/browse/YARN-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated YARN-6867: -- Attachment: YARN-6867.001.patch Added a new unit test in TestRM to demonstrate how an

[jira] [Created] (YARN-6867) AbstractYarnScheduler reports the configured maximum resources, instead of the actual, even after the configured waittime

Muhammad Samir Khan created YARN-6867: - Summary: AbstractYarnScheduler reports the configured maximum resources, instead of the actual, even after the configured waittime Key: YARN-6867 URL:

[jira] [Updated] (YARN-6834) A container request with only racks specified and relax locality set to false is never honoured

[ https://issues.apache.org/jira/browse/YARN-6834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated YARN-6834: -- Attachment: yarn-6834-unittest.patch > A container request with only racks specified and

[jira] [Created] (YARN-6834) A container request with only racks specified and relax locality set to false is never honoured

Muhammad Samir Khan created YARN-6834: - Summary: A container request with only racks specified and relax locality set to false is never honoured Key: YARN-6834 URL: