[jira] [Commented] (YARN-9773) Add QueueMetrics for Custom Resources

2019-09-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933733#comment-16933733 ] Eric Payne commented on YARN-9773: -- Thanks [~maniraj...@gmail.com] for the updated patch. Here are a

[jira] [Commented] (YARN-7817) Add Resource reference to RM's NodeInfo object so REST API can get non memory/vcore resource usages.

2019-09-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-7817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933698#comment-16933698 ] Eric Payne commented on YARN-7817: -- bq. It seems this patch breaks YARN-7860, please help port this patch

[jira] [Commented] (YARN-7817) Add Resource reference to RM's NodeInfo object so REST API can get non memory/vcore resource usages.

2019-09-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-7817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933538#comment-16933538 ] Eric Payne commented on YARN-7817: -- [~jhung], is there a plan to backport this to 2.10? If not, do you

[jira] [Commented] (YARN-7817) Add Resource reference to RM's NodeInfo object so REST API can get non memory/vcore resource usages.

2019-09-18 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-7817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932877#comment-16932877 ] Eric Payne commented on YARN-7817: -- [~sunilg], [~cheersyang], [~bibinchundatt], [~leftnoteasy]: I'd like

[jira] [Commented] (YARN-9762) Add submission context label to audit logs

2019-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926736#comment-16926736 ] Eric Payne commented on YARN-9762: -- {quote} bq. Can we just address adding the label to audit logs and do

[jira] [Commented] (YARN-9773) Add QueueMetrics for Custom Resources

2019-08-30 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919846#comment-16919846 ] Eric Payne commented on YARN-9773: -- Thanks for the patch, [~maniraj...@gmail.com]! I've taken a first

[jira] [Commented] (YARN-9770) Create a queue ordering policy which picks child queues with equal probability

2019-08-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918909#comment-16918909 ] Eric Payne commented on YARN-9770: -- {quote}When A's utilization reaches utilization of other queues (e.g.

[jira] [Updated] (YARN-9756) Create metric that sums total memory/vcores preempted per round

2019-08-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9756: - Fix Version/s: 3.1.4 3.2.2 2.9.3 2.8.6

[jira] [Commented] (YARN-9756) Create metric that sums total memory/vcores preempted per round

2019-08-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918136#comment-16918136 ] Eric Payne commented on YARN-9756: -- [~maniraj...@gmail.com], just FYI, the patches for branch-3.0 and

[jira] [Commented] (YARN-9756) Create metric that sums total memory/vcores preempted per round

2019-08-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918102#comment-16918102 ] Eric Payne commented on YARN-9756: -- Thanks a lot, [~maniraj...@gmail.com], for the updated patches. +1 I

[jira] [Commented] (YARN-9770) Create a queue ordering policy which picks child queues with equal probability

2019-08-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16917986#comment-16917986 ] Eric Payne commented on YARN-9770: -- Hi [~jhung]. I'm sorry but I don't understand everything about the

[jira] [Updated] (YARN-9773) Add QueueMetrics for Custom Resources

2019-08-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9773: - Summary: Add QueueMetrics for Custom Resources (was: Add QueueMetrics for Custom Resources/Resource

[jira] [Updated] (YARN-9773) Add QueueMetrics for Custom Resources/Resource vectors

2019-08-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9773: - Description: Although the custom resource metrics are calculated and saved as a

[jira] [Updated] (YARN-9773) Add QueueMetrics for Custom Resources/Resource vectors

2019-08-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9773: - Summary: Add QueueMetrics for Custom Resources/Resource vectors (was: PartitionQueueMetrics for Custom

[jira] [Commented] (YARN-9756) Create metric that sums total memory/vcores preempted per round

2019-08-26 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916040#comment-16916040 ] Eric Payne commented on YARN-9756: -- Also in 3.2 and earlier, {{QueueMetrics#updatePreemptedResources}}

[jira] [Commented] (YARN-9756) Create metric that sums total memory/vcores preempted per round

2019-08-26 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915951#comment-16915951 ] Eric Payne commented on YARN-9756: -- Hi [~maniraj...@gmail.com], thanks for the updated patch! We will

[jira] [Commented] (YARN-9756) Create metric that sums total memory/vcores preempted per round

2019-08-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913624#comment-16913624 ] Eric Payne commented on YARN-9756: -- Thanks for the updated patch, [~maniraj...@gmail.com]! I am fine with

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2019-08-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912677#comment-16912677 ] Eric Payne commented on YARN-6492: -- Thanks for creating the new JIRA, [~maniraj...@gmail.com]. I have

[jira] [Commented] (YARN-9766) YARN CapacityScheduler QueueMetrics has missing metrics for parent queues having same name

2019-08-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912581#comment-16912581 ] Eric Payne commented on YARN-9766: -- bq. I have tested a sample patch simply removing the old null check

[jira] [Commented] (YARN-9760) Support configuring application priorities on a workflow level

2019-08-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912521#comment-16912521 ] Eric Payne commented on YARN-9760: -- [~jhung], thanks for raising this interesting feature request. In

[jira] [Assigned] (YARN-9756) Create metric that sums total memory/vcores preempted per round

2019-08-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-9756: Assignee: Manikandan R (was: Eric Payne) Thanks [~maniraj...@gmail.com] for helping with this

[jira] [Commented] (YARN-9756) Create metric that sums total memory/vcores preempted per round

2019-08-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910627#comment-16910627 ] Eric Payne commented on YARN-9756: -- Thanks for investigating, [~maniraj...@gmail.com] ! These new

[jira] [Assigned] (YARN-9756) Create metric that sums total memory/vcores preempted per round

2019-08-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-9756: Assignee: Eric Payne > Create metric that sums total memory/vcores preempted per round >

[jira] [Created] (YARN-9756) Create metric that sums total memory/vcores preempted per round

2019-08-16 Thread Eric Payne (JIRA)
Eric Payne created YARN-9756: Summary: Create metric that sums total memory/vcores preempted per round Key: YARN-9756 URL: https://issues.apache.org/jira/browse/YARN-9756 Project: Hadoop YARN

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2019-08-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905471#comment-16905471 ] Eric Payne commented on YARN-6492: -- Thanks for the updated patch [~maniraj...@gmail.com]. I feel like

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2019-08-08 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903050#comment-16903050 ] Eric Payne commented on YARN-6492: -- Hi [~maniraj...@gmail.com]. Thanks for the updated patch. I see that

[jira] [Resolved] (YARN-9685) NPE when rendering the info table of leaf queue in non-accessible partitions

2019-08-08 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne resolved YARN-9685. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.3 3.2.1

[jira] [Commented] (YARN-7427) NullPointerException in ResourceInfo when queue has not used label

2019-08-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902424#comment-16902424 ] Eric Payne commented on YARN-7427: -- [~jhung], this appears to be fixed by YARN-9685. Any objections if I

[jira] [Commented] (YARN-9685) NPE when rendering the info table of leaf queue in non-accessible partitions

2019-08-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902422#comment-16902422 ] Eric Payne commented on YARN-9685: -- Thanks a lot, [~Tao Yang], for raising this issue and providing the

[jira] [Commented] (YARN-9720) MR job submitted to a queue with default partition accessing the non-exclusive label resources

2019-08-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901499#comment-16901499 ] Eric Payne commented on YARN-9720: -- [~gb.ana...@gmail.com], can you please attach a copy of your

[jira] [Commented] (YARN-6315) Improve LocalResourcesTrackerImpl#isResourcePresent to return false for corrupted files

2019-08-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901424#comment-16901424 ] Eric Payne commented on YARN-6315: -- [~kshukla], this came up internally for us recently. Do you plan on

[jira] [Commented] (YARN-9681) AM resource limit is incorrect for queue

2019-08-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898914#comment-16898914 ] Eric Payne commented on YARN-9681: -- [~gb.ana...@gmail.com], can you please help me understand the

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

2019-07-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896409#comment-16896409 ] Eric Payne commented on YARN-9596: -- Thanks for all your work on this, [~samkhan]. +1 to the backports as

[jira] [Commented] (YARN-9702) Backport YARN-5788 to branch-2.8

2019-07-29 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16895454#comment-16895454 ] Eric Payne commented on YARN-9702: -- Thanks [~samkhan] for the backport. +1. Will commit to branch-2.8 >

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

2019-07-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892226#comment-16892226 ] Eric Payne commented on YARN-9596: -- bq. The unit test failures are also happening in branch-3.0. Yes, I

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

2019-07-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892065#comment-16892065 ] Eric Payne commented on YARN-9596: -- Thanks, [~samkhan], for the 3.0 patch. The test failures for

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

2019-07-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891986#comment-16891986 ] Eric Payne commented on YARN-9596: -- I'd like to document why a branch-3.0 patch was necessary. In trunk

[jira] [Commented] (YARN-9668) UGI conf doesn't read user overridden configurations on RM and NM startup

2019-07-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891411#comment-16891411 ] Eric Payne commented on YARN-9668: -- Thanks [~jhung]. +1   I will commit to 3.0 > UGI conf doesn't read

[jira] [Commented] (YARN-9668) UGI conf doesn't read user overridden configurations on RM and NM startup

2019-07-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891289#comment-16891289 ] Eric Payne commented on YARN-9668: -- [~jhung], [~haibochen], This patch broke the 3.0 build: {code}

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

2019-07-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891165#comment-16891165 ] Eric Payne commented on YARN-9596: -- Okay. Thanks a lot [~samkhan] for the good work on reporting and

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

2019-07-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889183#comment-16889183 ] Eric Payne commented on YARN-9596: -- {quote}2. {code:java} if

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2019-07-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886414#comment-16886414 ] Eric Payne commented on YARN-6492: -- Thanks a lot for updating the patch, [~maniraj...@gmail.com].

[jira] [Commented] (YARN-462) Project Parameter for Chargeback

2019-07-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886402#comment-16886402 ] Eric Payne commented on YARN-462: - [~kthrapp], it has been several years. Is there still a need for this

[jira] [Commented] (YARN-3638) Yarn Resource Manager Scheduler page - show percentage of total cluster that each queue is using

2019-07-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886391#comment-16886391 ] Eric Payne commented on YARN-3638: -- Hi [~harisekhon], bq. You could also extend this idea show the % of

[jira] [Updated] (YARN-3638) Yarn Resource Manager Scheduler page - show percentage of total cluster that each queue is using

2019-07-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3638: - Attachment: Capacity Scheduler Page Shows Percentages of Cluster.png > Yarn Resource Manager Scheduler

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2019-07-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885321#comment-16885321 ] Eric Payne commented on YARN-6492: -- [~maniraj...@gmail.com], the current patches don't apply anymore. Do

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

2019-06-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868027#comment-16868027 ] Eric Payne commented on YARN-9596: -- [~samkhan], these changes look good to me for trunk. Do they backport

[jira] [Commented] (YARN-9202) RM does not track nodes that are in the include list and never register

2019-06-17 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866026#comment-16866026 ] Eric Payne commented on YARN-9202: -- [~kshukla], thank you for your detailed work in this patch. I am

[jira] [Commented] (YARN-8625) Aggregate Resource Allocation for each job is not present in ATS

2019-06-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854941#comment-16854941 ] Eric Payne commented on YARN-8625: -- [~Prabhu Joseph], in order to put these changes into branch-2.8 and

[jira] [Commented] (YARN-8625) Aggregate Resource Allocation for each job is not present in ATS

2019-05-29 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16851249#comment-16851249 ] Eric Payne commented on YARN-8625: -- [~Prabhu Joseph], This needs a branch-2 specific patch. String

[jira] [Updated] (YARN-9542) Fix LogsCLI guessAppOwner ignores custom file format suffix

2019-05-29 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9542: - Fix Version/s: (was: 3.2.2) (was: 3.2.1) [~Prabhu Joseph], fix versions are

[jira] [Commented] (YARN-9558) Log Aggregation testcases failing

2019-05-29 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16851046#comment-16851046 ] Eric Payne commented on YARN-9558: -- [~eyang] / [~Prabhu Joseph], so this failure is still happening in

[jira] [Commented] (YARN-8625) Aggregate Resource Allocation for each job is not present in ATS

2019-05-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847019#comment-16847019 ] Eric Payne commented on YARN-8625: -- Also, TestAHSWebServices is failing, and I would like to see that

[jira] [Commented] (YARN-8625) Aggregate Resource Allocation for each job is not present in ATS

2019-05-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846979#comment-16846979 ] Eric Payne commented on YARN-8625: -- [~Prabhu Joseph], it looks like the patch doesn't cleanly cherry-pick

[jira] [Commented] (YARN-8625) Aggregate Resource Allocation for each job is not present in ATS

2019-05-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846228#comment-16846228 ] Eric Payne commented on YARN-8625: -- [~Prabhu Joseph], I was able to reproduce your test results in my

[jira] [Commented] (YARN-8625) Aggregate Resource Allocation for each job is not present in ATS

2019-05-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838893#comment-16838893 ] Eric Payne commented on YARN-8625: -- [~Prabhu Joseph], I'm sorry but I can't get applications to show up

[jira] [Commented] (YARN-8625) Aggregate Resource Allocation for each job is not present in ATS

2019-05-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16837596#comment-16837596 ] Eric Payne commented on YARN-8625: -- [~Prabhu Joseph], In my environment, the

[jira] [Commented] (YARN-9202) RM does not track nodes that are in the include list and never register

2019-05-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16836617#comment-16836617 ] Eric Payne commented on YARN-9202: -- [~kshukla], thanks for your explanation. I think we should go ahead

[jira] [Updated] (YARN-9285) RM UI progress column is of wrong type

2019-05-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9285: - Fix Version/s: 3.1.3 2.10.0 > RM UI progress column is of wrong type >

[jira] [Commented] (YARN-9285) RM UI progress column is of wrong type

2019-05-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831938#comment-16831938 ] Eric Payne commented on YARN-9285: -- [~ahussein], branch-3 is not valid branch, so it won't need a patch.

[jira] [Commented] (YARN-9285) RM UI progress column is of wrong type

2019-05-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831906#comment-16831906 ] Eric Payne commented on YARN-9285: -- +1 LGTM Thanks [~ahussein], will commit shortly. > RM UI progress

[jira] [Commented] (YARN-9285) RM UI progress column is of wrong type

2019-05-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831299#comment-16831299 ] Eric Payne commented on YARN-9285: -- bq. do you still prefer to go in a common path? Separate is fine, but

[jira] [Commented] (YARN-9285) RM UI progress column is of wrong type

2019-05-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831284#comment-16831284 ] Eric Payne commented on YARN-9285: -- [~ahussein], Thanks for reporting and working on this issue. One

[jira] [Commented] (YARN-7129) Application Catalog for YARN applications

2019-03-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791043#comment-16791043 ] Eric Payne commented on YARN-7129: -- bq. Forcing all developers to add a -D flag to their builds to

[jira] [Commented] (YARN-7129) Application Catalog for YARN applications

2019-03-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790835#comment-16790835 ] Eric Payne commented on YARN-7129: -- Making changes that break builds for some portion of the community

[jira] [Commented] (YARN-5714) ContainerExecutor does not order environment map

2019-03-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786869#comment-16786869 ] Eric Payne commented on YARN-5714: -- Okay, I will backport this through to branch-2.8 > ContainerExecutor

[jira] [Commented] (YARN-5714) ContainerExecutor does not order environment map

2019-03-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785851#comment-16785851 ] Eric Payne commented on YARN-5714: -- [~Jim_Brennan], the ASF warning is from dependency-reduced-pom.xml

[jira] [Commented] (YARN-5714) ContainerExecutor does not order environment map

2019-03-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784990#comment-16784990 ] Eric Payne commented on YARN-5714: -- I kicked the pre-commit build, and since the branch-2.8 patch is the

[jira] [Commented] (YARN-8625) Aggregate Resource Allocation for each job is not present in ATS

2019-03-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781840#comment-16781840 ] Eric Payne commented on YARN-8625: -- bq. Prabhu Joseph These metrics holds good for running applications.

[jira] [Commented] (YARN-8625) Aggregate Resource Allocation for each job is not present in ATS

2019-02-27 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779414#comment-16779414 ] Eric Payne commented on YARN-8625: -- [~Prabhu Joseph], sorry for the delay. I will try to review it this

[jira] [Commented] (YARN-6538) Inter Queue preemption is not happening when DRF is configured

2019-02-20 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773177#comment-16773177 ] Eric Payne commented on YARN-6538: -- In practice, this seems to me to be an uncommon use case. For

[jira] [Commented] (YARN-7171) RM UI should sort memory / cores numerically

2019-02-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762831#comment-16762831 ] Eric Payne commented on YARN-7171: -- [~ahussein], thanks a lot for the fix! +1 LGTM I will commit shortly.

[jira] [Commented] (YARN-7171) RM UI should sort memory / cores numerically

2019-02-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762247#comment-16762247 ] Eric Payne commented on YARN-7171: -- {quote}while I wait for your updated branch 2.8 patch {quote} Sorry!

[jira] [Commented] (YARN-7171) RM UI should sort memory / cores numerically

2019-02-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762246#comment-16762246 ] Eric Payne commented on YARN-7171: -- [~ahussein], the design you chose is fine with me. The code changes

[jira] [Updated] (YARN-9278) Shuffle nodes when selecting to be preempted nodes

2019-02-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9278: - Component/s: fairscheduler > Shuffle nodes when selecting to be preempted nodes >

[jira] [Updated] (YARN-9277) Add more restrictions In FairScheduler Preemption

2019-02-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9277: - Component/s: fairscheduler > Add more restrictions In FairScheduler Preemption >

[jira] [Commented] (YARN-9260) Re-Launch ApplicationMasters That Fail With OOM Using Larger Container

2019-01-31 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757690#comment-16757690 ] Eric Payne commented on YARN-9260: -- This may already be clear, but I just want to campaign for this

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2019-01-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Affects Version/s: (was: 0.23.9) (was: 2.1.0-beta)

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2019-01-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Component/s: capacity scheduler > Provide optional means for a scheduler to check real user ACLs >

[jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-29 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755228#comment-16755228 ] Eric Payne commented on YARN-6616: -- [~Prabhu Joseph], thanks again for all of the good work on this

[jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-28 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754161#comment-16754161 ] Eric Payne commented on YARN-6616: -- bq. I see that there is no unit test added for the correction in

[jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-28 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754067#comment-16754067 ] Eric Payne commented on YARN-6616: -- [~Prabhu Joseph]. Thanks for the branch-2.8 and branch-2.7 patches.

[jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752749#comment-16752749 ] Eric Payne commented on YARN-6616: -- [~Prabhu Joseph], the patch LGTM. However, just a couple of things:

[jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752351#comment-16752351 ] Eric Payne commented on YARN-6616: -- bq. submitTime <= startTime <= launchTime <= finishTime [~Prabhu

[jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751752#comment-16751752 ] Eric Payne commented on YARN-6616: -- [~Prabhu Joseph], Thanks for the hard work on this issue. I'm sorry

[jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751491#comment-16751491 ] Eric Payne commented on YARN-6616: -- I will review today > YARN AHS shows submitTime for jobs same as

[jira] [Commented] (YARN-9202) RM does not track nodes that are in the include list and never register

2019-01-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750169#comment-16750169 ] Eric Payne commented on YARN-9202: -- {quote} bq. I do not see the nodes from the include list in the UI

[jira] [Updated] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6616: - Attachment: ApplicationReport.poc > YARN AHS shows submitTime for jobs same as startTime >

[jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749051#comment-16749051 ] Eric Payne commented on YARN-6616: -- [~Prabhu Joseph], thank you for updating the new patch.

[jira] [Commented] (YARN-9202) RM does not track nodes that are in the include list and never register

2019-01-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16746708#comment-16746708 ] Eric Payne commented on YARN-9202: -- Thanks, [~kshukla] for the hard work on this patch. I have a couple

[jira] [Commented] (YARN-9202) RM does not track nodes that are in the include list and never register

2019-01-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16746694#comment-16746694 ] Eric Payne commented on YARN-9202: -- In my manually testing of these changes, I do not see the nodes from

[jira] [Commented] (YARN-9210) YARN UI can not display node info

2019-01-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16746643#comment-16746643 ] Eric Payne commented on YARN-9210: -- Thanks for providing the patch, [~yangjiandan]. I was recently

[jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-17 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16745492#comment-16745492 ] Eric Payne commented on YARN-6616: -- bq. I also wonder how this fix getting in would not break

[jira] [Comment Edited] (YARN-8647) Add a flag to disable move app between queues

2018-11-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652189#comment-16652189 ] Eric Payne edited comment on YARN-8647 at 11/16/18 4:33 PM: {quote}Addition

[jira] [Commented] (YARN-7171) RM UI should sort memory / cores numerically

2018-11-14 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686821#comment-16686821 ] Eric Payne commented on YARN-7171: -- bq. it has been fixed in YARN-3466 This is not accurate. This problem

[jira] [Commented] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675661#comment-16675661 ] Eric Payne commented on YARN-8969: -- Is it wise to change the API of a public method in an abstract class?

[jira] [Commented] (YARN-7225) Add queue and partition info to RM audit log

2018-11-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673579#comment-16673579 ] Eric Payne commented on YARN-7225: -- Yes, [~jhung]. Very good catch. Sorry about that. +1 to the update.

[jira] [Commented] (YARN-7225) Add queue and partition info to RM audit log

2018-11-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671817#comment-16671817 ] Eric Payne commented on YARN-7225: -- [~jhung], I checked out the latest branch-2/branch-2.9, and the

[jira] [Commented] (YARN-7225) Add queue and partition info to RM audit log

2018-11-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671779#comment-16671779 ] Eric Payne commented on YARN-7225: -- Thanks [~jhung]. I have uploaded branch-2.8 patch 002. I am working

[jira] [Updated] (YARN-7225) Add queue and partition info to RM audit log

2018-11-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7225: - Attachment: YARN-7225.branch-2.8.002.patch > Add queue and partition info to RM audit log >

<    1   2   3   4   5   6   7   8   9   10   >