[jira] [Commented] (YARN-9887) Capacity scheduler: add support for limiting maxRunningApps per user

2019-10-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949690#comment-16949690 ] Eric Payne commented on YARN-9887: -- The Capacity Scheduler does have a concept of {color:#22}Max

[jira] [Created] (YARN-9894) CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues.

2019-10-11 Thread Eric Payne (Jira)
Eric Payne created YARN-9894: Summary: CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues. Key: YARN-9894 URL: https://issues.apache.org/jira/browse/YARN-9894 Project:

[jira] [Assigned] (YARN-9894) CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues.

2019-10-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-9894: Assignee: Eric Payne (was: Eric Payne) > CapacitySchedulerPerf test for measuring hundreds of

[jira] [Assigned] (YARN-9894) CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues.

2019-10-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-9894: Assignee: Eric Payne > CapacitySchedulerPerf test for measuring hundreds of apps in a large number

[jira] [Commented] (YARN-9882) QueueMetrics not coming in Capacity Scheduler with Node Label Configuration

2019-10-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949573#comment-16949573 ] Eric Payne commented on YARN-9882: -- [~gaurav.suman], for the sake of legacy, the metrics outside of the

[jira] [Assigned] (YARN-2127) Move YarnUncaughtExceptionHandler into Hadoop common

2019-10-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-2127: Assignee: Eric Payne (was: Eric Payne) > Move YarnUncaughtExceptionHandler into Hadoop common >

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2019-10-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951001#comment-16951001 ] Eric Payne commented on YARN-6492: -- [~gaurav.suman], my understanding is that branch-3.0 has been

[jira] [Commented] (YARN-9773) Add QueueMetrics for Custom Resources

2019-10-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951142#comment-16951142 ] Eric Payne commented on YARN-9773: -- [~maniraj...@gmail.com], Sorry for the long delay. Thanks for the

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2019-12-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000125#comment-17000125 ] Eric Payne commented on YARN-8292: -- Thanks a lot [~jhung] for looking at this. I apologize in advance for

[jira] [Commented] (YARN-9767) PartitionQueueMetrics Issues

2019-12-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000205#comment-17000205 ] Eric Payne commented on YARN-9767: -- [~maniraj...@gmail.com], Thanks for raising this issue and providing

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2019-12-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000257#comment-17000257 ] Eric Payne commented on YARN-6492: -- Thanks [~maniraj...@gmail.com] for all the work on this. bq.

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000184#comment-17000184 ] Eric Payne commented on YARN-10009: --- This is kind of a blocker for us. Would it be okay if [~ebadger]

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001721#comment-17001721 ] Eric Payne commented on YARN-10009: --- Thanks a lot for the help, [~ebadger] and [~leftnoteasy]! > In

[jira] [Commented] (YARN-10033) TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources

2019-12-18 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999203#comment-16999203 ] Eric Payne commented on YARN-10033: --- Thanks [~ebadger]! > TestProportionalCapacityPreemptionPolicy not

[jira] [Commented] (YARN-9894) CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues.

2019-12-18 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999523#comment-16999523 ] Eric Payne commented on YARN-9894: -- Thanks [~jhung]! > CapacitySchedulerPerf test for measuring hundreds

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001030#comment-17001030 ] Eric Payne commented on YARN-10009: --- [~ebadger], thanks for the review. bq. the other divideAndCeil

[jira] [Updated] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10009: -- Attachment: YARN-10009.004.patch > In Capacity Scheduler, DRC can treat minimum user limit percent as

[jira] [Updated] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2020-02-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9018: - Fix Version/s: 2.10.1 3.1.4 3.2.2 3.3.0 > Add

[jira] [Created] (YARN-10164) Allow NM to start even when custom resource type not defined

2020-02-25 Thread Eric Payne (Jira)
Eric Payne created YARN-10164: - Summary: Allow NM to start even when custom resource type not defined Key: YARN-10164 URL: https://issues.apache.org/jira/browse/YARN-10164 Project: Hadoop YARN

[jira] [Commented] (YARN-10140) TestTimelineAuthFilterForV2 fails due to login failures in branch-2.10

2020-02-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044565#comment-17044565 ] Eric Payne commented on YARN-10140: --- Thanks [~ahussein] for raising the issue and for providing the

[jira] [Reopened] (YARN-9790) Failed to set default-application-lifetime if maximum-application-lifetime is less than or equal to zero

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-9790: -- Reopening to backport to branch-3.2, 3.1, and 2.10. > Failed to set default-application-lifetime if

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.branch-3.1.006.patch > Allow inheritance of max app lifetime / default app

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.branch-3.2.006.patch > Allow inheritance of max app lifetime / default app

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.branch-2.10.006.patch > Allow inheritance of max app lifetime / default app

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2020-02-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031864#comment-17031864 ] Eric Payne commented on YARN-8292: -- [~jhung] / [~leftnoteasy], Would it be possible for you to take

[jira] [Commented] (YARN-10094) Add configuration to support NM overuse in RM

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022263#comment-17022263 ] Eric Payne commented on YARN-10094: --- YARN-1011 also seems to be very similar. > Add configuration to

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.branch-2.10.005.patch > Allow inheritance of max app lifetime / default app

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023225#comment-17023225 ] Eric Payne commented on YARN-10084: --- All patches are uploaded. Here is the breakdown of the

[jira] [Comment Edited] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023225#comment-17023225 ] Eric Payne edited comment on YARN-10084 at 1/24/20 7:59 PM: All patches are

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023105#comment-17023105 ] Eric Payne commented on YARN-10084: --- I attached patch for branch-3.1 > Allow inheritance of max app

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.branch-3.1.005.patch > Allow inheritance of max app lifetime / default app

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023103#comment-17023103 ] Eric Payne commented on YARN-10084: --- Unit test failures for TestCombinedSystemMetricsPublisher and

[jira] [Resolved] (YARN-9790) Failed to set default-application-lifetime if maximum-application-lifetime is less than or equal to zero

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne resolved YARN-9790. -- Fix Version/s: 2.10.1 3.1.4 3.2.2 Resolution: Fixed >

[jira] [Commented] (YARN-9790) Failed to set default-application-lifetime if maximum-application-lifetime is less than or equal to zero

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022467#comment-17022467 ] Eric Payne commented on YARN-9790: -- Backport completed. > Failed to set default-application-lifetime if

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022516#comment-17022516 ] Eric Payne commented on YARN-10084: --- Thanks [~ebadger]. I uploaded patch 005 that includes new and

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.005.patch > Allow inheritance of max app lifetime / default app lifetime >

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.006.patch > Allow inheritance of max app lifetime / default app lifetime >

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17025320#comment-17025320 ] Eric Payne commented on YARN-10084: --- [~Jim_Brennan] and [~ebadger], thanks for your review so far!

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.branch-3.2.005.patch > Allow inheritance of max app lifetime / default app

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-17 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.001.patch > Allow inheritance of max app lifetime / default app lifetime >

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-17 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: (was: BUILDING.txt) > Allow inheritance of max app lifetime / default app lifetime >

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-17 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: BUILDING.txt > Allow inheritance of max app lifetime / default app lifetime >

[jira] [Created] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-13 Thread Eric Payne (Jira)
Eric Payne created YARN-10084: - Summary: Allow inheritance of max app lifetime / default app lifetime Key: YARN-10084 URL: https://issues.apache.org/jira/browse/YARN-10084 Project: Hadoop YARN

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.003.patch > Allow inheritance of max app lifetime / default app lifetime >

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021440#comment-17021440 ] Eric Payne commented on YARN-10084: --- Thanks [~Jim_Brennan]. I uploaded version 003. > Allow

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021287#comment-17021287 ] Eric Payne commented on YARN-10084: --- Okay. Thanks for your further analysis, [~Jim_Brennan]. bq. a

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.002.patch > Allow inheritance of max app lifetime / default app lifetime >

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021294#comment-17021294 ] Eric Payne commented on YARN-10084: --- Version 002 attached. I did not change the logic since it already

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.004.patch > Allow inheritance of max app lifetime / default app lifetime >

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021554#comment-17021554 ] Eric Payne commented on YARN-10084: --- I clicked on the "compile" link above and it says: {noformat}

[jira] [Commented] (YARN-9790) Failed to set default-application-lifetime if maximum-application-lifetime is less than or equal to zero

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021574#comment-17021574 ] Eric Payne commented on YARN-9790: -- If there are no objections, I'd like to backport this all the way

[jira] [Commented] (YARN-10091) Support clean up orphan app's log in LogAggService

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021587#comment-17021587 ] Eric Payne commented on YARN-10091: --- [~cane], can you please be more specific? What is an orphan app

[jira] [Commented] (YARN-10090) ApplicationNotFoundException will cause a UndeclaredThrowableException

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021605#comment-17021605 ] Eric Payne commented on YARN-10090: --- [~yzzjjyy], can you please tell me where you are seeing this

[jira] [Commented] (YARN-10094) Add configuration to support NM overuse in RM

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021610#comment-17021610 ] Eric Payne commented on YARN-10094: --- [~cane], I feel that this JIRA may have the same goal as YARN-291.

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020605#comment-17020605 ] Eric Payne commented on YARN-10084: --- {quote} For some reason, I was under the impression that < 0 meant

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020602#comment-17020602 ] Eric Payne commented on YARN-10084: --- bq. should you be checking for >= 0 instead of >0 Good catch,

[jira] [Commented] (YARN-9052) Replace all MockRM submit method definitions with a builder

2020-01-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010710#comment-17010710 ] Eric Payne commented on YARN-9052: -- {quote}I am a little bit concerned with Jiras that solely opened for

[jira] [Commented] (YARN-7387) org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer fails intermittently

2020-01-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-7387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010940#comment-17010940 ] Eric Payne commented on YARN-7387: -- Thanks for the fix, [~Jim_Brennan]. The changes LGTM. +1 >

[jira] [Comment Edited] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2020-01-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011001#comment-17011001 ] Eric Payne edited comment on YARN-9018 at 1/8/20 8:36 PM: -- The patch still

[jira] [Commented] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2020-01-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011001#comment-17011001 ] Eric Payne commented on YARN-9018: -- I kicked the precommit build > Add functionality to

[jira] [Commented] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2020-01-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010996#comment-17010996 ] Eric Payne commented on YARN-9018: -- We've been running with this internally for a long time now. I'd like

[jira] [Commented] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2020-01-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011054#comment-17011054 ] Eric Payne commented on YARN-9018: -- +1. I will commit tomorrow if no objections. > Add functionality to

[jira] [Commented] (YARN-10072) TestCSAllocateCustomResource failures

2020-01-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009882#comment-17009882 ] Eric Payne commented on YARN-10072: --- The changes look good to me. I'll wait for the pre-commit build

[jira] [Commented] (YARN-10072) TestCSAllocateCustomResource failures

2020-01-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009938#comment-17009938 ] Eric Payne commented on YARN-10072: --- [~Jim_Brennan], the new CheckStyle warnings are due to the

[jira] [Commented] (YARN-10004) Javadoc of YarnConfigurationStore#initialize is not straightforward

2020-01-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010136#comment-17010136 ] Eric Payne commented on YARN-10004: --- [~snemeth], can you please be more specific about what is wrong

[jira] [Commented] (YARN-10072) TestCSAllocateCustomResource failures

2020-01-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010147#comment-17010147 ] Eric Payne commented on YARN-10072: --- +1. I'll commit tomorrow and port all branches back to

[jira] [Commented] (YARN-9427) TestContainerSchedulerQueuing.testKillOnlyRequiredOpportunisticContainers fails sporadically

2020-03-09 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055419#comment-17055419 ] Eric Payne commented on YARN-9427: -- Thanks for the patch, [~ahussein]. +1 LGTM I will commit. >

[jira] [Commented] (YARN-10192) CapacityScheduler stuck in loop rejecting allocation proposals

2020-03-12 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058049#comment-17058049 ] Eric Payne commented on YARN-10192: --- [~jhung], I'm not sure this is related, but does the Hadoop 2.10.0

[jira] [Commented] (YARN-10227) Pull YARN-8242 back to branch-2.10

2020-04-09 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079580#comment-17079580 ] Eric Payne commented on YARN-10227: --- The 2.10 patch looks good. +1 > Pull YARN-8242 back to

[jira] [Commented] (YARN-10227) Pull YARN-8242 back to branch-2.10

2020-04-09 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079461#comment-17079461 ] Eric Payne commented on YARN-10227: --- My preference is to re-open the original JIRA. That way the

[jira] [Updated] (YARN-10251) Show extended resources on legacy RM UI.

2020-04-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10251: -- Description: It would be great to update the legacy RM UI to include GPU resources in the overview and

[jira] [Created] (YARN-10251) Show extended resources on legacy RM UI.

2020-04-28 Thread Eric Payne (Jira)
Eric Payne created YARN-10251: - Summary: Show extended resources on legacy RM UI. Key: YARN-10251 URL: https://issues.apache.org/jira/browse/YARN-10251 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-9444) YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize yarn.io/gpu as a valid resource

2020-05-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099112#comment-17099112 ] Eric Payne commented on YARN-9444: -- Hi [~shuzirra]. Good work on reporting and fixing this issue! Thanks

[jira] [Commented] (YARN-9444) YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize yarn.io/gpu as a valid resource

2020-05-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099314#comment-17099314 ] Eric Payne commented on YARN-9444: -- I have patches available for 3.2, 3.1, and 2.10. Would you be

[jira] [Updated] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2020-04-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4771: - Target Version/s: (was: 2.7.5) > Some containers can be skipped during log aggregation after NM restart

[jira] [Commented] (YARN-1529) Add Localization overhead metrics to NM

2020-04-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090843#comment-17090843 ] Eric Payne commented on YARN-1529: -- bq. It might be worth splitting the patch so the less controversial

[jira] [Commented] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2020-04-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090800#comment-17090800 ] Eric Payne commented on YARN-4771: -- bq. This is going to be problematic, impacting NM memory usage. My

[jira] [Updated] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2020-04-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4771: - Affects Version/s: (was: 2.7.2) 2.10.0 3.2.1

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104657#comment-17104657 ] Eric Payne commented on YARN-6492: -- {quote} {code:java} "name" :

[jira] [Commented] (YARN-9444) YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize yarn.io/gpu as a valid resource

2020-05-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102782#comment-17102782 ] Eric Payne commented on YARN-9444: -- Thanks for the original patch [~shuzirra] and for the reviews

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104711#comment-17104711 ] Eric Payne commented on YARN-6492: -- {quote} IMO we should still have {code:java} "name" :

[jira] [Updated] (YARN-9444) YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize yarn.io/gpu as a valid resource

2020-05-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9444: - Attachment: commit.repo > YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize >

[jira] [Updated] (YARN-9444) YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize yarn.io/gpu as a valid resource

2020-05-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9444: - Attachment: (was: commit.repo) > YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't

[jira] [Commented] (YARN-9444) YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize yarn.io/gpu as a valid resource

2020-05-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101975#comment-17101975 ] Eric Payne commented on YARN-9444: -- I backported the trunk commit to branch-3.2 and branch-3.1.

[jira] [Commented] (YARN-9444) YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize yarn.io/gpu as a valid resource

2020-05-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101917#comment-17101917 ] Eric Payne commented on YARN-9444: -- I am able to backport the trunk commit revision directly to

[jira] [Updated] (YARN-9444) YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize yarn.io/gpu as a valid resource

2020-05-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9444: - Attachment: YARN-9444.branch-2.10.003.patch > YARN API ResourceUtils's getRequestedResourcesFromConfig

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102945#comment-17102945 ] Eric Payne commented on YARN-6492: -- Thanks [~maniraj...@gmail.com] for working to move this issue

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-09-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190392#comment-17190392 ] Eric Payne commented on YARN-9809: -- Unless there are objections, I would like to backport this to 3.1. >

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-09-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190414#comment-17190414 ] Eric Payne commented on YARN-9809: -- [~ebadger], this doesn't backport cleanly to 3.2. Would you mind

[jira] [Commented] (YARN-10353) Log vcores used and cumulative cpu in containers monitor

2020-09-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190393#comment-17190393 ] Eric Payne commented on YARN-10353: --- Unless there are objections, I would like to backport this to 3.1.

[jira] [Commented] (YARN-10369) Make NMTokenSecretManagerInRM sending NMToken for nodeId DEBUG

2020-09-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190394#comment-17190394 ] Eric Payne commented on YARN-10369: --- Unless there are objections, I would like to backport this to 3.1.

[jira] [Updated] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10390: -- Attachment: YARN-10390.002.patch > LeafQueue: retain user limits cache across assignContainers() calls

[jira] [Commented] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193731#comment-17193731 ] Eric Payne commented on YARN-10390: --- Uploaded patch to kick pre-commit build so we can have a record in

[jira] [Updated] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10390: -- Attachment: YARN-10390-branch-3.1.002.patch > LeafQueue: retain user limits cache across

[jira] [Commented] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193841#comment-17193841 ] Eric Payne commented on YARN-10390: --- Uploaded branch-3.2 patch because of merge conflicts in unit

[jira] [Updated] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10390: -- Attachment: YARN-10390-branch-3.2.002.patch > LeafQueue: retain user limits cache across

[jira] [Commented] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193833#comment-17193833 ] Eric Payne commented on YARN-10390: --- Unit test failure for {{TestFairSchedulerPreemption}} is the same

[jira] [Commented] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194279#comment-17194279 ] Eric Payne commented on YARN-10390: --- Thanks [~samkhan] for this important performance enhancement. +1.

[jira] [Commented] (YARN-950) Ability to limit or avoid aggregating logs beyond a certain size

2020-09-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194507#comment-17194507 ] Eric Payne commented on YARN-950: - [~adam.antal], are you still planning on working on this JIRA? bq. Ran

[jira] [Commented] (YARN-10177) Backport YARN-7307 to branch-2.10 Allow client/AM update supported resource types via YARN APIs

2020-09-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190782#comment-17190782 ] Eric Payne commented on YARN-10177: --- Thanks [~sunilg] for the original work, [~weichiu] for the effort

<    7   8   9   10   11   12   13   14   15   >