[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415053#comment-17415053 ] Wangda Tan commented on YARN-10178: --- [~pbacsko], [~MatthewSharp], I just took a quick l

[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273944#comment-17273944 ] Wangda Tan commented on YARN-10178: --- [~zhuqi], [~bteke], I'm wondering if it is the rig

[jira] [Updated] (YARN-10587) Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode.

[ https://issues.apache.org/jira/browse/YARN-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10587: -- Fix Version/s: 3.4.0 > Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode. >

[jira] [Updated] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10531: -- Fix Version/s: 3.4.0 > Be able to disable user limit factor for CapacityScheduler Leaf Queue >

[jira] [Commented] (YARN-10587) Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode.

[ https://issues.apache.org/jira/browse/YARN-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269479#comment-17269479 ] Wangda Tan commented on YARN-10587: --- +1, thanks [~zhuqi] > Fix AutoCreateLeafQueueCrea

[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269469#comment-17269469 ] Wangda Tan commented on YARN-10531: --- +1, thanks [~zhuqi], will get it in later today.

[jira] [Commented] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269424#comment-17269424 ] Wangda Tan commented on YARN-10581: --- +1, patch looks good, thanks [~snemeth] > CS Flex

[jira] [Commented] (YARN-10579) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include weight values for queues

[ https://issues.apache.org/jira/browse/YARN-10579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17268857#comment-17268857 ] Wangda Tan commented on YARN-10579: --- Thanks [~snemeth], +1 to the latest patch. > CS

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17268757#comment-17268757 ] Wangda Tan commented on YARN-10352: --- cc: [~ztang] to do a review. > Skip schedule on n

[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17268755#comment-17268755 ] Wangda Tan commented on YARN-10531: --- Thanks [~zhuqi],  Two minor comments:  1) Parent

[jira] [Commented] (YARN-10587) Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode.

[ https://issues.apache.org/jira/browse/YARN-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17268743#comment-17268743 ] Wangda Tan commented on YARN-10587: --- Thanks [~zhuqi], I think the fix is correct, but

[jira] [Commented] (YARN-10578) Fix Auto Queue Creation parent handling

[ https://issues.apache.org/jira/browse/YARN-10578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17267508#comment-17267508 ] Wangda Tan commented on YARN-10578: --- +1 to the latest patch, submitted patch to trigger

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17266391#comment-17266391 ] Wangda Tan commented on YARN-10532: --- [~zhuqi], thanks for the patch, I took a brief loo

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17266385#comment-17266385 ] Wangda Tan commented on YARN-10506: --- Verified the test failure is an intermittent one w

[jira] [Updated] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10506: -- Attachment: YARN-10506.017.patch > Update queue creation logic to use weight mode and allow the flexibl

[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17266294#comment-17266294 ] Wangda Tan commented on YARN-10531: --- [~zhuqi], I haven't reviewed details of the patch

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17266292#comment-17266292 ] Wangda Tan commented on YARN-10506: --- Thanks for the additional comments, I +1 to the la

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17265652#comment-17265652 ] Wangda Tan commented on YARN-10506: --- Thanks [~zhuqi], the latest patch looks good to me

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17265521#comment-17265521 ] Wangda Tan commented on YARN-10506: --- Sounds good, thanks [~shuzirra], [~pbacsko]. It ma

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17265149#comment-17265149 ] Wangda Tan commented on YARN-10506: --- [~pbacsko], I see, I think it makes sense. {quote}

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17265085#comment-17265085 ] Wangda Tan commented on YARN-10506: --- Thanks [~shuzirra], [~pbacsko], posting this comme

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17264661#comment-17264661 ] Wangda Tan commented on YARN-10506: --- Thanks [~zhuqi], I don't have further comments, +1

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17264397#comment-17264397 ] Wangda Tan commented on YARN-10506: --- Reg. *2) How we deal with the queue's auto-queue-c

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17264390#comment-17264390 ] Wangda Tan commented on YARN-10506: --- [~zhuqi], [~gandras],  I just took a look at the

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17264238#comment-17264238 ] Wangda Tan commented on YARN-10506: --- Can we also take care of javac warnings? > Update

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17264237#comment-17264237 ] Wangda Tan commented on YARN-10506: --- Thanks [~zhuqi] and [~gandras] for quick updates! 

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17263672#comment-17263672 ] Wangda Tan commented on YARN-10506: --- Thanks for all updates, here's my comments:    1

[jira] [Commented] (YARN-10564) Support Auto Queue Creation template configurations

[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17263575#comment-17263575 ] Wangda Tan commented on YARN-10564: --- Thanks [~zhuqi], let's get YARN-10506 done shortly

[jira] [Assigned] (YARN-10564) Support Auto Queue Creation template configurations

[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-10564: - Assignee: zhuqi (was: Andras Gyori) > Support Auto Queue Creation template configurations > ---

[jira] [Assigned] (YARN-10535) Make changes in queue placement policy to use auto-queue-placement API in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-10535: - Assignee: Gergely Pollak > Make changes in queue placement policy to use auto-queue-placement AP

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17263457#comment-17263457 ] Wangda Tan commented on YARN-10506: --- [~zhuqi], [~gandras] can you check the findbugs wa

[jira] [Comment Edited] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17263018#comment-17263018 ] Wangda Tan edited comment on YARN-10504 at 1/12/21, 1:58 AM: -

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Fix Version/s: 3.4.0 > Implement weight mode in Capacity Scheduler > --

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17263018#comment-17263018 ] Wangda Tan commented on YARN-10504: --- Committed to trunk, thanks to everybody who contri

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262985#comment-17262985 ] Wangda Tan commented on YARN-10497: --- [~shuzirra], [~pbacsko] can you review the latest

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262853#comment-17262853 ] Wangda Tan commented on YARN-10504: --- It looks like folks are generally OK with getting

[jira] [Comment Edited] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262853#comment-17262853 ] Wangda Tan edited comment on YARN-10504 at 1/11/21, 6:35 PM: -

[jira] [Commented] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262813#comment-17262813 ] Wangda Tan commented on YARN-10559: --- Removed fix version of the Jira. > Fair sharing i

[jira] [Comment Edited] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262813#comment-17262813 ] Wangda Tan edited comment on YARN-10559 at 1/11/21, 5:21 PM: -

[jira] [Updated] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10559: -- Fix Version/s: (was: 3.1.4) > Fair sharing intra-queue preemption support in Capacity Scheduler > -

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262751#comment-17262751 ] Wangda Tan commented on YARN-10504: --- Thanks [~zhuqi], [~bteke] and review from [~sunilg

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262394#comment-17262394 ] Wangda Tan commented on YARN-10504: --- Attached ver.010, it should be able to fix all tes

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: (was: YARN-10504.010.patch) > Implement weight mode in Capacity Scheduler > ---

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.010.patch > Implement weight mode in Capacity Scheduler > --

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.010.patch > Implement weight mode in Capacity Scheduler > --

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262323#comment-17262323 ] Wangda Tan commented on YARN-10506: --- Attached ver.6 combined patch (which includes YARN

[jira] [Updated] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10506: -- Attachment: YARN-10506.006-combined.patch > Update queue creation logic to use weight mode and allow th

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262321#comment-17262321 ] Wangda Tan commented on YARN-10504: --- Uploaded ver.009, fixed more test failures. I run

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.009.patch > Implement weight mode in Capacity Scheduler > --

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262302#comment-17262302 ] Wangda Tan commented on YARN-10506: --- Manually rebased patch on top of the latest YARN-1

[jira] [Updated] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10506: -- Attachment: YARN-10506.006.patch > Update queue creation logic to use weight mode and allow the flexibl

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262301#comment-17262301 ] Wangda Tan commented on YARN-10504: --- Still see some issues around auto created leaf que

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.008.patch > Implement weight mode in Capacity Scheduler > --

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262257#comment-17262257 ] Wangda Tan commented on YARN-10504: --- Thanks [~bteke], I'm checking the failures now. >

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.006.patch > Implement weight mode in Capacity Scheduler > --

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261943#comment-17261943 ] Wangda Tan commented on YARN-10504: --- Updated ver.6 patch, which includes the following:

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261921#comment-17261921 ] Wangda Tan commented on YARN-10504: --- Make sense [~zhuqi]. [~bteke]/[~gandras] , if you

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261774#comment-17261774 ] Wangda Tan commented on YARN-10504: --- 1) AbstractCSQueue, lots of format changes, can we

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260114#comment-17260114 ] Wangda Tan commented on YARN-10504: --- [~gandras], Thanks for updating this, your observ

[jira] [Created] (YARN-10535) Make changes in queue placement policy to use auto-queue-placement API in CapacityScheduler

Wangda Tan created YARN-10535: - Summary: Make changes in queue placement policy to use auto-queue-placement API in CapacityScheduler Key: YARN-10535 URL: https://issues.apache.org/jira/browse/YARN-10535 P

[jira] [Commented] (YARN-10535) Make changes in queue placement policy to use auto-queue-placement API in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17250003#comment-17250003 ] Wangda Tan commented on YARN-10535: --- cc: [~shuzirra], [~pbacsko] > Make changes in que

[jira] [Assigned] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-10506: - Assignee: Andras Gyori > Update queue creation logic to use weight mode and allow the flexible

[jira] [Commented] (YARN-10295) CapacityScheduler NPE can cause apps to get stuck without resources

[ https://issues.apache.org/jira/browse/YARN-10295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17249870#comment-17249870 ] Wangda Tan commented on YARN-10295: --- [~snemeth], just come across the issue, I saw a bu

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248261#comment-17248261 ] Wangda Tan commented on YARN-10506: --- Uploaded a patch, which is based on YARN-10504. It

[jira] [Updated] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10506: -- Attachment: YARN-10506.001.patch > Update queue creation logic to use weight mode and allow the flexibl

[jira] [Created] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

Wangda Tan created YARN-10532: - Summary: Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used Key: YARN-10532 URL: https://issues.apache.org/jira/browse/YARN-10532

[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248149#comment-17248149 ] Wangda Tan commented on YARN-10531: --- [~zhuqi] do you want to take a try on this one?

[jira] [Created] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

Wangda Tan created YARN-10531: - Summary: Be able to disable user limit factor for CapacityScheduler Leaf Queue Key: YARN-10531 URL: https://issues.apache.org/jira/browse/YARN-10531 Project: Hadoop YARN

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.ver-3.patch > Implement weight mode in Capacity Scheduler >

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248114#comment-17248114 ] Wangda Tan commented on YARN-10504: --- [~zhuqi], thank you so much for your review. [~bte

[jira] [Commented] (YARN-10530) CapacityScheduler ResourceLimits doesn't handle node partition well

[ https://issues.apache.org/jira/browse/YARN-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248087#comment-17248087 ] Wangda Tan commented on YARN-10530: --- I haven't written any UT yet, but I just want to f

[jira] [Commented] (YARN-10530) CapacityScheduler ResourceLimits doesn't handle node partition well

[ https://issues.apache.org/jira/browse/YARN-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248084#comment-17248084 ] Wangda Tan commented on YARN-10530: --- cc: [~sunilg], [~epayne] > CapacityScheduler Reso

[jira] [Created] (YARN-10530) CapacityScheduler ResourceLimits doesn't handle node partition well

Wangda Tan created YARN-10530: - Summary: CapacityScheduler ResourceLimits doesn't handle node partition well Key: YARN-10530 URL: https://issues.apache.org/jira/browse/YARN-10530 Project: Hadoop YARN

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248048#comment-17248048 ] Wangda Tan commented on YARN-10506: --- I'm looking at PoC of the patch now, and will keep

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247615#comment-17247615 ] Wangda Tan commented on YARN-10504: --- The patch doesn't handle auto queue creation well,

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247614#comment-17247614 ] Wangda Tan commented on YARN-10504: --- Thanks [~zhuqi], as we discussed, we're working on

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.ver-2.patch > Implement weight mode in Capacity Scheduler >

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.ver-1.patch > Implement weight mode in Capacity Scheduler >

[jira] [Commented] (YARN-10169) Mixed absolute resource value and percentage-based resource value in CapacityScheduler should fail

[ https://issues.apache.org/jira/browse/YARN-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17241917#comment-17241917 ] Wangda Tan commented on YARN-10169: --- Thanks [~zhuqi] for working on this. We're current

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17241173#comment-17241173 ] Wangda Tan commented on YARN-10504: --- [~epayne], This is a feature to allow flexibly add

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238837#comment-17238837 ] Wangda Tan commented on YARN-10497: --- [~shuzirra], I would still prefer to use the Capa

[jira] [Updated] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10497: -- Attachment: YARN-10497.004.patch > Fix an issue in CapacityScheduler which fails to delete queues > ---

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238410#comment-17238410 ] Wangda Tan commented on YARN-10497: --- Attached ver.3 patch, fixed checkstyle, and unit t

[jira] [Updated] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10497: -- Attachment: YARN-10497.003.patch > Fix an issue in CapacityScheduler which fails to delete queues > ---

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238365#comment-17238365 ] Wangda Tan commented on YARN-10497: --- Patch 002, fixed check style issue, and unit test

[jira] [Updated] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10497: -- Attachment: YARN-10497.002.patch > Fix an issue in CapacityScheduler which fails to delete queues > ---

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17236509#comment-17236509 ] Wangda Tan commented on YARN-10497: --- [~snemeth], [~pbacsko], [~shuzirra], [~bteke] can

[jira] [Updated] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10497: -- Attachment: YARN-10497.001.patch > Fix an issue in CapacityScheduler which fails to delete queues > ---

[jira] [Created] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

Wangda Tan created YARN-10497: - Summary: Fix an issue in CapacityScheduler which fails to delete queues Key: YARN-10497 URL: https://issues.apache.org/jira/browse/YARN-10497 Project: Hadoop YARN

[jira] [Assigned] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-10497: - Assignee: Wangda Tan > Fix an issue in CapacityScheduler which fails to delete queues >

[jira] [Commented] (YARN-10482) Capacity Scheduler seems locked,RM cannot submit any new job,and change active RM manually return to normal

[ https://issues.apache.org/jira/browse/YARN-10482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17236286#comment-17236286 ] Wangda Tan commented on YARN-10482: --- Thanks [~jiwq]! it is very helpful! > Capacity Sc

[jira] [Commented] (YARN-10492) deadlock in rm

[ https://issues.apache.org/jira/browse/YARN-10492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17235833#comment-17235833 ] Wangda Tan commented on YARN-10492: --- That will be helpful, thanks Jufeng! > deadlock i

[jira] [Commented] (YARN-10496) [Umbrella] Support Flexible Auto Queue Creation in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17235683#comment-17235683 ] Wangda Tan commented on YARN-10496: --- Worked with [~bteke] for a design doc, see the lin

[jira] [Created] (YARN-10496) [Umbrella] Support Flexible Auto Queue Creation in Capacity Scheduler

Wangda Tan created YARN-10496: - Summary: [Umbrella] Support Flexible Auto Queue Creation in Capacity Scheduler Key: YARN-10496 URL: https://issues.apache.org/jira/browse/YARN-10496 Project: Hadoop YARN

[jira] [Commented] (YARN-10492) deadlock in rm

[ https://issues.apache.org/jira/browse/YARN-10492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233880#comment-17233880 ] Wangda Tan commented on YARN-10492: --- cc: [~snemeth]  , [~pbacsko], [~tangzhankun], [~su

[jira] [Updated] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10458: -- Fix Version/s: 3.4.0 > Hive On Tez queries fails upon submission to dynamically created pools > ---

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223771#comment-17223771 ] Wangda Tan commented on YARN-10458: --- I just committed the patch to trunk, thanks [~anan

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223735#comment-17223735 ] Wangda Tan commented on YARN-10458: --- +1, thanks [~pbacsko], will get it committed later

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223117#comment-17223117 ] Wangda Tan commented on YARN-10458: --- [~pbacsko], there're two issues in the test, one i

[jira] [Commented] (YARN-10425) Replace the legacy placement engine in CS with the new one

[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17221619#comment-17221619 ] Wangda Tan commented on YARN-10425: --- Thanks [~shuzirra], this is a really big and impor

  1   2   3   4   5   6   7   8   9   10   >