[jira] [Commented] (YARN-10613) Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF

2021-02-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289319#comment-17289319 ] Eric Payne commented on YARN-10613: --- Thanks for the suggestion, [~Jim_Brennan]! I have

[jira] [Commented] (YARN-10613) Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF

2021-02-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289323#comment-17289323 ] Eric Payne commented on YARN-10613: --- As far as property names go, the logical thing to

[jira] [Commented] (YARN-10613) Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF

2021-02-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289393#comment-17289393 ] Eric Payne commented on YARN-10613: --- Actually, I want to change my suggestions to the f

[jira] [Commented] (YARN-10613) Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF

2021-02-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17289407#comment-17289407 ] Eric Payne commented on YARN-10613: --- I was wrong in my original assessment. To be consi

[jira] [Updated] (YARN-10613) Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF

2021-02-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10613: -- Attachment: YARN-10613.trunk.001.patch > Config to allow Intra- and Inter-queue preemption to enable/d

[jira] [Updated] (YARN-10613) Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF

2021-02-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10613: -- Attachment: YARN-10613.trunk.002.patch > Config to allow Intra- and Inter-queue preemption to enable/d

[jira] [Commented] (YARN-10613) Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF

2021-02-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17290483#comment-17290483 ] Eric Payne commented on YARN-10613: --- Thanks a lot, [~Jim_Brennan], for the review! I h

[jira] [Updated] (YARN-10613) Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF

2021-02-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10613: -- Attachment: YARN-10613.branch-2.10.002.patch > Config to allow Intra- and Inter-queue preemption to en

[jira] [Commented] (YARN-10613) Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF

2021-02-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17290587#comment-17290587 ] Eric Payne commented on YARN-10613: --- The {{TestRMRestart}} failure is unrelated to this

[jira] [Commented] (YARN-10613) Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF

2021-02-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17291022#comment-17291022 ] Eric Payne commented on YARN-10613: --- I don't think the unit test failures were related.

[jira] [Updated] (YARN-10613) Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF

2021-02-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10613: -- Attachment: YARN-10613.branch-3.2.002.patch > Config to allow Intra- and Inter-queue preemption to ena

[jira] [Commented] (YARN-10613) Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF

2021-02-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17291154#comment-17291154 ] Eric Payne commented on YARN-10613: --- Thanks [~Jim_Brennan]. I have uploaded the branch-

[jira] [Comment Edited] (YARN-10613) Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF

2021-02-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17291154#comment-17291154 ] Eric Payne edited comment on YARN-10613 at 2/25/21, 7:15 PM: -

[jira] [Commented] (YARN-10588) Percentage of queue and cluster is zero in WebUI

2021-03-01 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293221#comment-17293221 ] Eric Payne commented on YARN-10588: --- [~BilwaST], sorry for the delay in replying. bq.

[jira] [Commented] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

2021-03-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294871#comment-17294871 ] Eric Payne commented on YARN-10559: --- [~ananyo_rao], sorry for the delay. I'm trying to

[jira] [Commented] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

2021-03-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17295609#comment-17295609 ] Eric Payne commented on YARN-10559: --- [~ananyo_rao], I am still walking through the chan

[jira] [Commented] (YARN-10588) Percentage of queue and cluster is zero in WebUI

2021-03-09 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17298159#comment-17298159 ] Eric Payne commented on YARN-10588: --- [~BilwaST], sorry for the delay. I will look at th

[jira] [Commented] (YARN-10588) Percentage of queue and cluster is zero in WebUI

2021-03-09 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17298332#comment-17298332 ] Eric Payne commented on YARN-10588: --- Thanks [~BilwaST] for reporting the issue and the

[jira] [Commented] (YARN-10588) Percentage of queue and cluster is zero in WebUI

2021-03-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300876#comment-17300876 ] Eric Payne commented on YARN-10588: --- bq. I wonder if we should be looping over the fir

[jira] [Commented] (YARN-10588) Percentage of queue and cluster is zero in WebUI

2021-03-15 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301831#comment-17301831 ] Eric Payne commented on YARN-10588: --- OK. Thanks [~BilwaST] and [~Jim_Brennan]! +1 I wil

[jira] [Updated] (YARN-10588) Percentage of queue and cluster is zero in WebUI

2021-03-15 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10588: -- Fix Version/s: 3.4.0 > Percentage of queue and cluster is zero in WebUI >

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

2021-03-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304984#comment-17304984 ] Eric Payne commented on YARN-10503: --- [~leftnoteasy] and [~sunilg], is there a reason cu

[jira] [Commented] (YARN-6538) Inter Queue preemption is not happening when DRF is configured

2021-03-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-6538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17305144#comment-17305144 ] Eric Payne commented on YARN-6538: -- [~novaboy], please provide a specific use case to rep

[jira] [Commented] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

2021-03-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308158#comment-17308158 ] Eric Payne commented on YARN-10517: --- I'll try to look this afternoon. > QueueMetrics h

[jira] [Commented] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

2021-03-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308849#comment-17308849 ] Eric Payne commented on YARN-10517: --- [~sibyl.lv] / [~zhuqi]. I can't seem to reproduce

[jira] [Updated] (YARN-10660) YARN Web UI have problem when show node partitions resource

2021-03-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10660: -- Fix Version/s: (was: 3.2.2) (was: 3.2.1) (was: 3.1.1)

[jira] [Commented] (YARN-10791) Graceful decomission cause NPE during Rolling upgrade from 2.6 to 3.2

2021-05-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17353558#comment-17353558 ] Eric Payne commented on YARN-10791: --- [~Song Jiacheng], When the NodeManager daemon is b

[jira] [Commented] (YARN-10821) User limit is not calculated as per definition for preemption

2021-06-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363004#comment-17363004 ] Eric Payne commented on YARN-10821: --- Thanks [~gandras] for bringing this up. I will tak

[jira] [Commented] (YARN-10821) User limit is not calculated as per definition for preemption

2021-06-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363169#comment-17363169 ] Eric Payne commented on YARN-10821: --- {quote} In LeafQueue#getUserAMResourceLimitPer

[jira] [Commented] (YARN-10821) User limit is not calculated as per definition for preemption

2021-06-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363171#comment-17363171 ] Eric Payne commented on YARN-10821: --- {quote} - In UsersManager#computeUserLimit the us

[jira] [Commented] (YARN-10802) Change Capacity Scheduler minimum-user-limit-percent to accept decimal values

2021-06-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363215#comment-17363215 ] Eric Payne commented on YARN-10802: --- [~bteke], Thanks for raising this issue and for wo

[jira] [Commented] (YARN-10821) User limit is not calculated as per definition for preemption

2021-06-17 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364966#comment-17364966 ] Eric Payne commented on YARN-10821: --- [~gandras], I am running behind. I will try to get

[jira] [Commented] (YARN-10821) User limit is not calculated as per definition for preemption

2021-06-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366823#comment-17366823 ] Eric Payne commented on YARN-10821: --- [~gandras], can you please provide a step-by-step

[jira] [Comment Edited] (YARN-10821) User limit is not calculated as per definition for preemption

2021-06-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366823#comment-17366823 ] Eric Payne edited comment on YARN-10821 at 6/21/21, 8:07 PM: -

[jira] [Comment Edited] (YARN-10821) User limit is not calculated as per definition for preemption

2021-06-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366823#comment-17366823 ] Eric Payne edited comment on YARN-10821 at 6/21/21, 8:08 PM: -

[jira] [Commented] (YARN-10824) Title not set for JHS and NM webpages

2021-06-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366828#comment-17366828 ] Eric Payne commented on YARN-10824: --- bq. I'm not sure "About the Node" is a good title

[jira] [Created] (YARN-10834) Intra-queue preemption: apps that don't use defined custom resource won't be preempted.

2021-06-25 Thread Eric Payne (Jira)
Eric Payne created YARN-10834: - Summary: Intra-queue preemption: apps that don't use defined custom resource won't be preempted. Key: YARN-10834 URL: https://issues.apache.org/jira/browse/YARN-10834 Proje

[jira] [Updated] (YARN-10834) Intra-queue preemption: apps that don't use defined custom resource won't be preempted.

2021-06-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10834: -- Attachment: YARN-10834.001.patch > Intra-queue preemption: apps that don't use defined custom resource

[jira] [Commented] (YARN-10834) Intra-queue preemption: apps that don't use defined custom resource won't be preempted.

2021-06-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17370890#comment-17370890 ] Eric Payne commented on YARN-10834: --- Thanks very much, [~Jim_Brennan]. I have uploaded

[jira] [Updated] (YARN-10834) Intra-queue preemption: apps that don't use defined custom resource won't be preempted.

2021-06-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10834: -- Attachment: YARN-10834.branch-2.10.001.patch > Intra-queue preemption: apps that don't use defined cust

[jira] [Commented] (YARN-10821) User limit is not calculated as per definition for preemption

2021-07-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376054#comment-17376054 ] Eric Payne commented on YARN-10821: --- {quote} {noformat} max ((total resources consumed

[jira] [Comment Edited] (YARN-10821) User limit is not calculated as per definition for preemption

2021-07-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376054#comment-17376054 ] Eric Payne edited comment on YARN-10821 at 7/6/21, 10:00 PM: -

[jira] [Updated] (YARN-10456) RM PartitionQueueMetrics records are named QueueMetrics in Simon metrics registry

2021-07-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10456: -- Attachment: YARN-10456.001.patch > RM PartitionQueueMetrics records are named QueueMetrics in Simon met

[jira] [Commented] (YARN-10456) RM PartitionQueueMetrics records are named QueueMetrics in Simon metrics registry

2021-07-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17380826#comment-17380826 ] Eric Payne commented on YARN-10456: --- [~Jim_Brennan], [~ebadger], [~edfi202], [~prabhujo

[jira] [Commented] (YARN-10505) Extend the maximum-capacity property to support Fair Scheduler migration

2021-08-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397371#comment-17397371 ] Eric Payne commented on YARN-10505: --- bq. Please note, that the new, recommended format

[jira] [Commented] (YARN-10505) Extend the maximum-capacity property to support Fair Scheduler migration

2021-08-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397407#comment-17397407 ] Eric Payne commented on YARN-10505: --- Thanks for clearing that up! > Extend the maximum

[jira] [Commented] (YARN-9975) Support proxy ACL user for CapacityScheduler

2021-08-18 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17401092#comment-17401092 ] Eric Payne commented on YARN-9975: -- bq. zhoukang, does this JIRA have the same requiremen

[jira] [Commented] (YARN-9975) Support proxy ACL user for CapacityScheduler

2021-08-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17401825#comment-17401825 ] Eric Payne commented on YARN-9975: -- [~cane] / [~snemeth], for about a year, we have been

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-08-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Attachment: YARN-1115.001.patch > Provide optional means for a scheduler to check real user ACLs > ---

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-08-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Description: In the framework for secure implementation using UserGroupInformation.doAs (https://hadoop.a

[jira] [Commented] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-08-26 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17405298#comment-17405298 ] Eric Payne commented on YARN-1115: -- The pre-commit build failed because of the dependency

[jira] [Commented] (YARN-10848) Vcore allocation problem with DefaultResourceCalculator

2021-08-31 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17407661#comment-17407661 ] Eric Payne commented on YARN-10848: --- bq. IMO this is breaking the existing behavior of

[jira] [Commented] (YARN-10899) control whether non-exclusive allocation is used

2021-08-31 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17407699#comment-17407699 ] Eric Payne commented on YARN-10899: --- {quote} When node label expression is empty strin

[jira] [Assigned] (YARN-10935) AM Total Queue Limit goes below per-uwer AM Limit if parent is full.

2021-09-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-10935: - Assignee: Eric Payne > AM Total Queue Limit goes below per-uwer AM Limit if parent is full. > --

[jira] [Created] (YARN-10935) AM Total Queue Limit goes below per-uwer AM Limit if parent is full.

2021-09-07 Thread Eric Payne (Jira)
Eric Payne created YARN-10935: - Summary: AM Total Queue Limit goes below per-uwer AM Limit if parent is full. Key: YARN-10935 URL: https://issues.apache.org/jira/browse/YARN-10935 Project: Hadoop YARN

[jira] [Updated] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10935: -- Summary: AM Total Queue Limit goes below per-user AM Limit if parent is full. (was: AM Total Queue Lim

[jira] [Updated] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10935: -- Attachment: Screen Shot 2021-09-07 at 12.49.52 PM.png > AM Total Queue Limit goes below per-user AM Lim

[jira] [Commented] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411398#comment-17411398 ] Eric Payne commented on YARN-10935: --- For example, In the following screenshot, the adve

[jira] [Updated] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10935: -- Attachment: Screen Shot 2021-09-07 at 12.55.37 PM.png > AM Total Queue Limit goes below per-user AM Lim

[jira] [Updated] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10935: -- Attachment: YARN-10935.001.patch > AM Total Queue Limit goes below per-user AM Limit if parent is full.

[jira] [Updated] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10935: -- Attachment: YARN-10935.002.patch > AM Total Queue Limit goes below per-user AM Limit if parent is full.

[jira] [Commented] (YARN-10903) Too many "Failed to accept allocation proposal" because of wrong Headroom check for DRF

2021-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413222#comment-17413222 ] Eric Payne commented on YARN-10903: --- Thanks [~jackwangcs] and [~Tao Yang] for raising t

[jira] [Commented] (YARN-10903) Too many "Failed to accept allocation proposal" because of wrong Headroom check for DRF

2021-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413346#comment-17413346 ] Eric Payne commented on YARN-10903: --- Thanks [~jackwangcs] for your patience and thanks

[jira] [Commented] (YARN-9975) Support proxy ACL user for CapacityScheduler

2021-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413370#comment-17413370 ] Eric Payne commented on YARN-9975: -- AFAICT, the requirements outlined in [zhoukang's comm

[jira] [Commented] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413374#comment-17413374 ] Eric Payne commented on YARN-10935: --- I suspect I could use {{fitsIn}} instead of {{isA

[jira] [Updated] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10935: -- Attachment: YARN-10935.003.patch > AM Total Queue Limit goes below per-user AM Limit if parent is full.

[jira] [Commented] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413415#comment-17413415 ] Eric Payne commented on YARN-10935: --- I attached v3 of the patch. > AM Total Queue Limi

[jira] [Commented] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17414291#comment-17414291 ] Eric Payne commented on YARN-10935: --- [~prabhujoseph], [~sunilg], [~ahussein], [~ebadger

[jira] [Commented] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-15 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415771#comment-17415771 ] Eric Payne commented on YARN-10935: --- Thanks for the reviews, [~ahussein] and [~ebadger]

[jira] [Updated] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10935: -- Attachment: YARN-10935.branch-2.10.003.patch > AM Total Queue Limit goes below per-user AM Limit if par

[jira] [Commented] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17416276#comment-17416276 ] Eric Payne commented on YARN-10935: --- Attaching the branch-2.10 patch. Will look into th

[jira] [Updated] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10935: -- Attachment: YARN-10935.branch-3.2.003.patch > AM Total Queue Limit goes below per-user AM Limit if pare

[jira] [Commented] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17416314#comment-17416314 ] Eric Payne commented on YARN-10935: --- OK, attached branch-3.2 patch. Thanks [~ebadger].

[jira] [Commented] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-09-17 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17416853#comment-17416853 ] Eric Payne commented on YARN-1115: -- [~gandras], thank you a lot for the review! {quote} *

[jira] [Comment Edited] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-09-17 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17416853#comment-17416853 ] Eric Payne edited comment on YARN-1115 at 9/17/21, 6:43 PM: [~

[jira] [Comment Edited] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-09-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17416853#comment-17416853 ] Eric Payne edited comment on YARN-1115 at 9/20/21, 4:44 PM: [~

[jira] [Commented] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-09-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17417744#comment-17417744 ] Eric Payne commented on YARN-1115: -- bq. I re-defined the user variable from String to be

[jira] [Commented] (YARN-10938) Support reservation scheduling enabled switch for capacity scheduler

2021-09-30 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423018#comment-17423018 ] Eric Payne commented on YARN-10938: --- [~Weihao Zheng] Reservations are somewhat integral

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2021-10-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17424069#comment-17424069 ] Eric Payne commented on YARN-8127: -- I'd like to backport this to 2.10. If no objections,

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2021-10-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-8127: - Attachment: YARN-8127.branch-2.10.004.patch > Resource leak when async scheduling is enabled > ---

[jira] [Reopened] (YARN-8127) Resource leak when async scheduling is enabled

2021-10-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-8127: -- Attched branch-2.10 patch. Reopening and putting in PATCH AVAILABLE state to kick the prec-mmit build. The

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2021-10-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17424217#comment-17424217 ] Eric Payne commented on YARN-8127: -- It looks like the unit tests didn't run because of a

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2021-10-05 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17424650#comment-17424650 ] Eric Payne commented on YARN-8127: -- Also, FWIW, all tests that ran passed: {noformat} [IN

[jira] [Commented] (YARN-8546) Resource leak caused by a reserved container being released more than once under async scheduling

2021-10-05 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17424713#comment-17424713 ] Eric Payne commented on YARN-8546: -- In conjunction with YARN-8127, I'd also like to backp

[jira] [Reopened] (YARN-8546) Resource leak caused by a reserved container being released more than once under async scheduling

2021-10-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-8546: -- > Resource leak caused by a reserved container being released more than once > under async scheduling > ---

[jira] [Updated] (YARN-8546) Resource leak caused by a reserved container being released more than once under async scheduling

2021-10-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-8546: - Attachment: YARN-8546.branch-2.10.001.patch > Resource leak caused by a reserved container being released

[jira] [Commented] (YARN-8546) Resource leak caused by a reserved container being released more than once under async scheduling

2021-10-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17425185#comment-17425185 ] Eric Payne commented on YARN-8546: -- I uploaded branch-2.10 patch. The {{FiCaSchedulerApp}

[jira] [Resolved] (YARN-9975) Support proxy ACL user for CapacityScheduler

2021-10-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne resolved YARN-9975. -- Resolution: Duplicate I'm closing this as a dup of YARN-1115. Please reopen if you disagree. > Support

[jira] [Commented] (YARN-8546) Resource leak caused by a reserved container being released more than once under async scheduling

2021-10-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17426215#comment-17426215 ] Eric Payne commented on YARN-8546: -- [~Tao Yang], [~cheersyang], if there are no objection

[jira] [Commented] (YARN-8222) Fix potential NPE when gets RMApp from RM context

2021-10-12 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17427832#comment-17427832 ] Eric Payne commented on YARN-8222: -- This bug caused our RM to crash on a production clust

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Attachment: YARN-1115.002.patch > Provide optional means for a scheduler to check real user ACLs > ---

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Attachment: YARN-1115.branch-3.3.002.patch > Provide optional means for a scheduler to check real user ACL

[jira] [Commented] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17428951#comment-17428951 ] Eric Payne commented on YARN-1115: -- {quote} |-1|mvninstall|0m 42s|https://ci-hadoop.apac

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Attachment: (was: YARN-1115.branch-3.3.002.patch) > Provide optional means for a scheduler to check re

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Attachment: YARN-1115.003.patch > Provide optional means for a scheduler to check real user ACLs > ---

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Attachment: YARN-1115.004.patch > Provide optional means for a scheduler to check real user ACLs > ---

[jira] [Commented] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17431371#comment-17431371 ] Eric Payne commented on YARN-1115: -- I have now attached version 004 of this patch. Patch

[jira] [Commented] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17432096#comment-17432096 ] Eric Payne commented on YARN-1115: -- [~ahussein], the precommit build for patch 004 looks

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Attachment: YARN-1115.branch-3.3.004.patch > Provide optional means for a scheduler to check real user ACL

[jira] [Commented] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17432594#comment-17432594 ] Eric Payne commented on YARN-1115: -- bq. Eric Payne were you able to build branch-3.3 loca

<    1   2   3   4   5   6   7   8   9   10   >