[jira] [Commented] (YARN-9992) Max allocation per queue is zero for custom resource types on RM startup

2019-12-02 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986454#comment-16986454 ] Eric Payne commented on YARN-9992: -- [~jhung], it looks like this is only a problem on bra

[jira] [Updated] (YARN-10009) DRF can treat minimum user limit percent as a max when custom resource is defined

2019-12-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10009: -- Component/s: capacity scheduler > DRF can treat minimum user limit percent as a max when custom resourc

[jira] [Updated] (YARN-10009) In Capacity Scheduler, DRF can treat minimum user limit percent as a max when custom resource is defined

2019-12-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10009: -- Summary: In Capacity Scheduler, DRF can treat minimum user limit percent as a max when custom resource

[jira] [Updated] (YARN-10009) In Capacity Scheduler, DRF can treat minimum user limit percent as a max when custom resource is defined

2019-12-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10009: -- Attachment: YARN-10009.001.patch > In Capacity Scheduler, DRF can treat minimum user limit percent as a

[jira] [Updated] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10009: -- Summary: In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource

[jira] [Commented] (YARN-9992) Max allocation per queue is zero for custom resource types on RM startup

2019-12-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16987105#comment-16987105 ] Eric Payne commented on YARN-9992: -- The code changes look fine, but I'm still trying to u

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16987181#comment-16987181 ] Eric Payne commented on YARN-10009: --- [~sunilg], [~jhung], [~leftnoteasy], could I pleas

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2019-12-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16987222#comment-16987222 ] Eric Payne commented on YARN-8292: -- I would like to get this back to branch-2.10. [~sunil

[jira] [Comment Edited] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986411#comment-16986411 ] Eric Payne edited comment on YARN-10009 at 12/4/19 6:12 PM: T

[jira] [Commented] (YARN-9992) Max allocation per queue is zero for custom resource types on RM startup

2019-12-05 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16988937#comment-16988937 ] Eric Payne commented on YARN-9992: -- Thanks [~jhung] , I verified that backporting YARN-92

[jira] [Updated] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-05 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10009: -- Attachment: YARN-10009.002.patch > In Capacity Scheduler, DRC can treat minimum user limit percent as a

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-05 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16989002#comment-16989002 ] Eric Payne commented on YARN-10009: --- Thank you very much for the review, [~leftnoteasy]

[jira] [Updated] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10009: -- Attachment: YARN-10009.003.patch > In Capacity Scheduler, DRC can treat minimum user limit percent as a

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16990024#comment-16990024 ] Eric Payne commented on YARN-10009: --- Upmerged and attached patch version 003. > In Cap

[jira] [Updated] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10009: -- Attachment: YARN-10009.branch-2.10.003.patch > In Capacity Scheduler, DRC can treat minimum user limit

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16990202#comment-16990202 ] Eric Payne commented on YARN-10009: --- [~leftnoteasy], thanks for looking at this. bq. is

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993913#comment-16993913 ] Eric Payne commented on YARN-10009: --- [~leftnoteasy], just a gentle reminder, asking you

[jira] [Updated] (YARN-9894) CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues.

2019-12-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9894: - Attachment: YARN-9894.002.patch > CapacitySchedulerPerf test for measuring hundreds of apps in a large num

[jira] [Commented] (YARN-9894) CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues.

2019-12-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993925#comment-16993925 ] Eric Payne commented on YARN-9894: -- Thanks a lot, [~jhung] for your review comments. Sorr

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2019-12-12 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16994856#comment-16994856 ] Eric Payne commented on YARN-8292: -- Failure of TestProportionalCapacityPreemptionPolicy s

[jira] [Created] (YARN-10033) TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources

2019-12-13 Thread Eric Payne (Jira)
Eric Payne created YARN-10033: - Summary: TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources Key: YARN-10033 URL: https://issues.apache.org/jira/browse/YARN-10033

[jira] [Assigned] (YARN-10033) TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources

2019-12-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-10033: - Assignee: Eric Payne > TestProportionalCapacityPreemptionPolicy not initializing vcores for > e

[jira] [Updated] (YARN-10033) TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources

2019-12-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10033: -- Attachment: YARN-10033.001.patch > TestProportionalCapacityPreemptionPolicy not initializing vcores for

[jira] [Updated] (YARN-10033) TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources

2019-12-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10033: -- Attachment: YARN-10033.002.patch > TestProportionalCapacityPreemptionPolicy not initializing vcores for

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2019-12-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-8292: - Attachment: YARN-8292.branch-2.011.patch > Fix the dominant resource preemption cannot happen when some of

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2019-12-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995876#comment-16995876 ] Eric Payne commented on YARN-8292: -- I attached patch version 011 for branch-2.10. The ch

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2019-12-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-8292: - Attachment: (was: YARN-8292.branch-2.011.patch) > Fix the dominant resource preemption cannot happen w

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2019-12-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-8292: - Attachment: YARN-8292.branch-2.10.011.patch > Fix the dominant resource preemption cannot happen when some

[jira] [Updated] (YARN-10033) TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources

2019-12-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10033: -- Affects Version/s: 3.2.1 3.1.3 > TestProportionalCapacityPreemptionPolicy not in

[jira] [Commented] (YARN-10033) TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources

2019-12-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997612#comment-16997612 ] Eric Payne commented on YARN-10033: --- [~ebadger], would you mind taking a look? > TestP

[jira] [Commented] (YARN-10033) TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources

2019-12-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997701#comment-16997701 ] Eric Payne commented on YARN-10033: --- Thanks a lot for the review, [~ebadger]. Yes, I ag

[jira] [Updated] (YARN-10033) TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources

2019-12-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10033: -- Attachment: YARN-10033.003.patch > TestProportionalCapacityPreemptionPolicy not initializing vcores for

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-17 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16998290#comment-16998290 ] Eric Payne commented on YARN-10009: --- [~leftnoteasy], any cycles for this? > In Capacit

[jira] [Commented] (YARN-10033) TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources

2019-12-18 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16999203#comment-16999203 ] Eric Payne commented on YARN-10033: --- Thanks [~ebadger]! > TestProportionalCapacityPree

[jira] [Commented] (YARN-9894) CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues.

2019-12-18 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16999523#comment-16999523 ] Eric Payne commented on YARN-9894: -- Thanks [~jhung]! > CapacitySchedulerPerf test for me

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2019-12-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000125#comment-17000125 ] Eric Payne commented on YARN-8292: -- Thanks a lot [~jhung] for looking at this. I apologiz

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000184#comment-17000184 ] Eric Payne commented on YARN-10009: --- This is kind of a blocker for us. Would it be okay

[jira] [Commented] (YARN-9767) PartitionQueueMetrics Issues

2019-12-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000205#comment-17000205 ] Eric Payne commented on YARN-9767: -- [~maniraj...@gmail.com], Thanks for raising this issu

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2019-12-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000257#comment-17000257 ] Eric Payne commented on YARN-6492: -- Thanks [~maniraj...@gmail.com] for all the work on th

[jira] [Updated] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10009: -- Attachment: YARN-10009.004.patch > In Capacity Scheduler, DRC can treat minimum user limit percent as a

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17001030#comment-17001030 ] Eric Payne commented on YARN-10009: --- [~ebadger], thanks for the review. bq. the other d

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17001721#comment-17001721 ] Eric Payne commented on YARN-10009: --- Thanks a lot for the help, [~ebadger] and [~leftno

[jira] [Commented] (YARN-10072) TestCSAllocateCustomResource failures

2020-01-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009882#comment-17009882 ] Eric Payne commented on YARN-10072: --- The changes look good to me. I'll wait for the pre

[jira] [Commented] (YARN-10072) TestCSAllocateCustomResource failures

2020-01-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009938#comment-17009938 ] Eric Payne commented on YARN-10072: --- [~Jim_Brennan], the new CheckStyle warnings are du

[jira] [Commented] (YARN-10004) Javadoc of YarnConfigurationStore#initialize is not straightforward

2020-01-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010136#comment-17010136 ] Eric Payne commented on YARN-10004: --- [~snemeth], can you please be more specific about

[jira] [Commented] (YARN-10072) TestCSAllocateCustomResource failures

2020-01-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010147#comment-17010147 ] Eric Payne commented on YARN-10072: --- +1. I'll commit tomorrow and port all branches bac

[jira] [Commented] (YARN-9052) Replace all MockRM submit method definitions with a builder

2020-01-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010710#comment-17010710 ] Eric Payne commented on YARN-9052: -- {quote}I am a little bit concerned with Jiras that so

[jira] [Commented] (YARN-7387) org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer fails intermittently

2020-01-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-7387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010940#comment-17010940 ] Eric Payne commented on YARN-7387: -- Thanks for the fix, [~Jim_Brennan]. The changes LGTM.

[jira] [Commented] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2020-01-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010996#comment-17010996 ] Eric Payne commented on YARN-9018: -- We've been running with this internally for a long ti

[jira] [Comment Edited] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2020-01-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011001#comment-17011001 ] Eric Payne edited comment on YARN-9018 at 1/8/20 8:36 PM: -- The pa

[jira] [Commented] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2020-01-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011001#comment-17011001 ] Eric Payne commented on YARN-9018: -- I kicked the precommit build > Add functionality to

[jira] [Commented] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2020-01-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011054#comment-17011054 ] Eric Payne commented on YARN-9018: -- +1. I will commit tomorrow if no objections. > Add f

[jira] [Created] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-13 Thread Eric Payne (Jira)
Eric Payne created YARN-10084: - Summary: Allow inheritance of max app lifetime / default app lifetime Key: YARN-10084 URL: https://issues.apache.org/jira/browse/YARN-10084 Project: Hadoop YARN I

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-17 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.001.patch > Allow inheritance of max app lifetime / default app lifetime > -

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-17 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: (was: BUILDING.txt) > Allow inheritance of max app lifetime / default app lifetime > --

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-17 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: BUILDING.txt > Allow inheritance of max app lifetime / default app lifetime > -

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020602#comment-17020602 ] Eric Payne commented on YARN-10084: --- bq. should you be checking for >= 0 instead of >0

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020605#comment-17020605 ] Eric Payne commented on YARN-10084: --- {quote} For some reason, I was under the impressio

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.002.patch > Allow inheritance of max app lifetime / default app lifetime > -

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021287#comment-17021287 ] Eric Payne commented on YARN-10084: --- Okay. Thanks for your further analysis, [~Jim_Bren

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021294#comment-17021294 ] Eric Payne commented on YARN-10084: --- Version 002 attached. I did not change the logic s

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.003.patch > Allow inheritance of max app lifetime / default app lifetime > -

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021440#comment-17021440 ] Eric Payne commented on YARN-10084: --- Thanks [~Jim_Brennan]. I uploaded version 003. >

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021554#comment-17021554 ] Eric Payne commented on YARN-10084: --- I clicked on the "compile" link above and it says:

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.004.patch > Allow inheritance of max app lifetime / default app lifetime > -

[jira] [Commented] (YARN-9790) Failed to set default-application-lifetime if maximum-application-lifetime is less than or equal to zero

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021574#comment-17021574 ] Eric Payne commented on YARN-9790: -- If there are no objections, I'd like to backport this

[jira] [Commented] (YARN-10091) Support clean up orphan app's log in LogAggService

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021587#comment-17021587 ] Eric Payne commented on YARN-10091: --- [~cane], can you please be more specific? What is

[jira] [Commented] (YARN-10090) ApplicationNotFoundException will cause a UndeclaredThrowableException

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021605#comment-17021605 ] Eric Payne commented on YARN-10090: --- [~yzzjjyy], can you please tell me where you are s

[jira] [Commented] (YARN-10094) Add configuration to support NM overuse in RM

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021610#comment-17021610 ] Eric Payne commented on YARN-10094: --- [~cane], I feel that this JIRA may have the same g

[jira] [Reopened] (YARN-9790) Failed to set default-application-lifetime if maximum-application-lifetime is less than or equal to zero

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-9790: -- Reopening to backport to branch-3.2, 3.1, and 2.10. > Failed to set default-application-lifetime if maximum

[jira] [Commented] (YARN-10094) Add configuration to support NM overuse in RM

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022263#comment-17022263 ] Eric Payne commented on YARN-10094: --- YARN-1011 also seems to be very similar. > Add co

[jira] [Resolved] (YARN-9790) Failed to set default-application-lifetime if maximum-application-lifetime is less than or equal to zero

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne resolved YARN-9790. -- Fix Version/s: 2.10.1 3.1.4 3.2.2 Resolution: Fixed > Faile

[jira] [Commented] (YARN-9790) Failed to set default-application-lifetime if maximum-application-lifetime is less than or equal to zero

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022467#comment-17022467 ] Eric Payne commented on YARN-9790: -- Backport completed. > Failed to set default-applicat

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022516#comment-17022516 ] Eric Payne commented on YARN-10084: --- Thanks [~ebadger]. I uploaded patch 005 that inclu

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.005.patch > Allow inheritance of max app lifetime / default app lifetime > -

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.branch-3.2.005.patch > Allow inheritance of max app lifetime / default app lifet

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023103#comment-17023103 ] Eric Payne commented on YARN-10084: --- Unit test failures for TestCombinedSystemMetricsPu

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023105#comment-17023105 ] Eric Payne commented on YARN-10084: --- I attached patch for branch-3.1 > Allow inheritan

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.branch-3.1.005.patch > Allow inheritance of max app lifetime / default app lifet

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.branch-2.10.005.patch > Allow inheritance of max app lifetime / default app life

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023225#comment-17023225 ] Eric Payne commented on YARN-10084: --- All patches are uploaded. Here is the breakdown of

[jira] [Comment Edited] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023225#comment-17023225 ] Eric Payne edited comment on YARN-10084 at 1/24/20 7:59 PM: A

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.006.patch > Allow inheritance of max app lifetime / default app lifetime > -

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17025320#comment-17025320 ] Eric Payne commented on YARN-10084: --- [~Jim_Brennan] and [~ebadger], thanks for your rev

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.branch-3.2.006.patch > Allow inheritance of max app lifetime / default app lifet

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.branch-3.1.006.patch > Allow inheritance of max app lifetime / default app lifet

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.branch-2.10.006.patch > Allow inheritance of max app lifetime / default app life

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2020-02-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17031864#comment-17031864 ] Eric Payne commented on YARN-8292: -- [~jhung] / [~leftnoteasy], Would it be possible for

[jira] [Commented] (YARN-10140) TestTimelineAuthFilterForV2 fails due to login failures in branch-2.10

2020-02-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17044565#comment-17044565 ] Eric Payne commented on YARN-10140: --- Thanks [~ahussein] for raising the issue and for p

[jira] [Updated] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2020-02-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9018: - Fix Version/s: 2.10.1 3.1.4 3.2.2 3.3.0 > Add fun

[jira] [Created] (YARN-10164) Allow NM to start even when custom resource type not defined

2020-02-25 Thread Eric Payne (Jira)
Eric Payne created YARN-10164: - Summary: Allow NM to start even when custom resource type not defined Key: YARN-10164 URL: https://issues.apache.org/jira/browse/YARN-10164 Project: Hadoop YARN I

[jira] [Commented] (YARN-9427) TestContainerSchedulerQueuing.testKillOnlyRequiredOpportunisticContainers fails sporadically

2020-03-09 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17055419#comment-17055419 ] Eric Payne commented on YARN-9427: -- Thanks for the patch, [~ahussein]. +1 LGTM I will c

[jira] [Commented] (YARN-10192) CapacityScheduler stuck in loop rejecting allocation proposals

2020-03-12 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058049#comment-17058049 ] Eric Payne commented on YARN-10192: --- [~jhung], I'm not sure this is related, but does t

[jira] [Commented] (YARN-10227) Pull YARN-8242 back to branch-2.10

2020-04-09 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17079461#comment-17079461 ] Eric Payne commented on YARN-10227: --- My preference is to re-open the original JIRA. Tha

[jira] [Commented] (YARN-10227) Pull YARN-8242 back to branch-2.10

2020-04-09 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17079580#comment-17079580 ] Eric Payne commented on YARN-10227: --- The 2.10 patch looks good. +1 > Pull YARN-8242 ba

[jira] [Commented] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2020-04-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17090800#comment-17090800 ] Eric Payne commented on YARN-4771: -- bq. This is going to be problematic, impacting NM mem

[jira] [Updated] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2020-04-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4771: - Affects Version/s: (was: 2.7.2) 2.10.0 3.2.1

[jira] [Updated] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2020-04-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4771: - Target Version/s: (was: 2.7.5) > Some containers can be skipped during log aggregation after NM restart

[jira] [Commented] (YARN-1529) Add Localization overhead metrics to NM

2020-04-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17090843#comment-17090843 ] Eric Payne commented on YARN-1529: -- bq. It might be worth splitting the patch so the les

[jira] [Created] (YARN-10251) Show extended resources on legacy RM UI.

2020-04-28 Thread Eric Payne (Jira)
Eric Payne created YARN-10251: - Summary: Show extended resources on legacy RM UI. Key: YARN-10251 URL: https://issues.apache.org/jira/browse/YARN-10251 Project: Hadoop YARN Issue Type: Improvemen

<    1   2   3   4   5   6   7   8   9   10   >