[jira] [Updated] (YARN-10599) fs2cs should generate new "auto-queue-creation-v2.enabled" properties for all parents

2021-01-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10599: Description: The property {{yarn.scheduler.capacity..auto-queue-creation-v2.enabled}} is not

[jira] [Commented] (YARN-10598) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information

2021-01-26 Thread Sunil G (Jira)
[ https://issues.apache.org/jira/browse/YARN-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272546#comment-17272546 ] Sunil G commented on YARN-10598: [~bteke] [~snemeth] queueType cannot be changed as It will be

[jira] [Commented] (YARN-10598) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information

2021-01-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272378#comment-17272378 ] Hadoop QA commented on YARN-10598: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272281#comment-17272281 ] Hadoop QA commented on YARN-10585: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-26 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10585: -- Fix Version/s: 3.4.0 > Create a class which can convert from legacy mapping rule format to the

[jira] [Commented] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-26 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272274#comment-17272274 ] Szilard Nemeth commented on YARN-10585: --- Thanks [~shuzirra] for this, good job! Latest patch LGTM,

[jira] [Updated] (YARN-10598) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information

2021-01-26 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10598: - Attachment: YARN-10598.001.patch > CS Flexible Auto Queue Creation: Modify RM /scheduler

[jira] [Commented] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272247#comment-17272247 ] Hadoop QA commented on YARN-10596: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10587) Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode.

2021-01-26 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10587: -- Fix Version/s: 3.4.0 > Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode. >

[jira] [Updated] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2021-01-26 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10531: -- Fix Version/s: 3.4.0 > Be able to disable user limit factor for CapacityScheduler Leaf Queue >

[jira] [Commented] (YARN-10428) Zombie applications in the YARN queue using FAIR + sizebasedweight

2021-01-26 Thread Guang Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272213#comment-17272213 ] Guang Yang commented on YARN-10428: --- Hi [~gandras] : I'm pretty sure the root cause is the

[jira] [Updated] (YARN-10599) fs2cs should generate new "auto-queue-creation-v2.enabled" properties for all parents

2021-01-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10599: Description: The property {{yarn.scheduler.capacity..auto-queue-creation-v2.enabled}} is not

[jira] [Commented] (YARN-10576) Update Capacity Scheduler documentation about JSON-based placement mapping

2021-01-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272173#comment-17272173 ] Hadoop QA commented on YARN-10576: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-10599) fs2cs should generate new "auto-queue-creation-v2.enabled" properties for all parents

2021-01-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10599: Description: The property {{yarn.scheduler.capacity..auto-queue-creation-v2.enabled}} is not

[jira] [Commented] (YARN-10584) Move the functionality of MappingRuleValidationHelper to CSQueueManager

2021-01-26 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272168#comment-17272168 ] Andras Gyori commented on YARN-10584: - I think this should be done in tandem with YARN-10571. I have

[jira] [Commented] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

2021-01-26 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272169#comment-17272169 ] Szilard Nemeth commented on YARN-10581: --- Resolving this Jira as [~pbacsko] committed it last week.

[jira] [Created] (YARN-10599) fs2cs should generate new "auto-queue-creation-v2.enabled" properties for all parents

2021-01-26 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10599: --- Summary: fs2cs should generate new "auto-queue-creation-v2.enabled" properties for all parents Key: YARN-10599 URL: https://issues.apache.org/jira/browse/YARN-10599

[jira] [Commented] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-26 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272161#comment-17272161 ] Szilard Nemeth commented on YARN-10596: --- Hi [~gandras], Thanks for working on this.  Latest patch

[jira] [Updated] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-26 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10596: -- Fix Version/s: 3.4.0 > Allow static definition of childless ParentQueues with

[jira] [Updated] (YARN-10576) Update Capacity Scheduler documentation about JSON-based placement mapping

2021-01-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10576: Attachment: YARN-10576-001.patch > Update Capacity Scheduler documentation about JSON-based

[jira] [Updated] (YARN-10598) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information

2021-01-26 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10598: - Description: Under this umbrella (YARN-10496), weight-mode has been implemented for CS with

[jira] [Updated] (YARN-10598) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information

2021-01-26 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10598: - Description: Under this umbrella (YARN-10496), weight-mode has been implemented for CS with

[jira] [Updated] (YARN-10598) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information

2021-01-26 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10598: - Description: Under this umbrella (YARN-10496), weight-mode has been implemented for CS with

[jira] [Commented] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-26 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272123#comment-17272123 ] Andras Gyori commented on YARN-10596: - Thank you [~bteke] and [~pbacsko] for the review. Fixed the

[jira] [Updated] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-26 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10596: Attachment: YARN-10596.002.patch > Allow static definition of childless ParentQueues with

[jira] [Assigned] (YARN-10598) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information

2021-01-26 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke reassigned YARN-10598: Assignee: Benjamin Teke (was: Szilard Nemeth) > CS Flexible Auto Queue Creation: Modify

[jira] [Created] (YARN-10598) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information

2021-01-26 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10598: Summary: CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information Key: YARN-10598 URL:

[jira] [Commented] (YARN-10564) Support Auto Queue Creation template configurations

2021-01-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272094#comment-17272094 ] Hadoop QA commented on YARN-10564: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10564) Support Auto Queue Creation template configurations

2021-01-26 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10564: Attachment: YARN-10564.002.patch > Support Auto Queue Creation template configurations >

[jira] [Commented] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272089#comment-17272089 ] Hadoop QA commented on YARN-10585: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10428) Zombie applications in the YARN queue using FAIR + sizebasedweight

2021-01-26 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272081#comment-17272081 ] Andras Gyori commented on YARN-10428: - [~yguang11] if you do not mind, I will take it over, as we are

[jira] [Commented] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-26 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272072#comment-17272072 ] Gergely Pollak commented on YARN-10585: --- Latest patch fixed [~gandras] "userGroupMappingRules and

[jira] [Commented] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272073#comment-17272073 ] Hadoop QA commented on YARN-10585: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-26 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10585: -- Attachment: YARN-10585.003.patch > Create a class which can convert from legacy mapping rule

[jira] [Commented] (YARN-10592) Support QueueCapacities to use vector based multi resource types, and update absolute related to use first.

2021-01-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272001#comment-17272001 ] Hadoop QA commented on YARN-10592: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-10592) Support QueueCapacities to use vector based multi resource types, and update absolute related to use first.

2021-01-26 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271183#comment-17271183 ] zhuqi edited comment on YARN-10592 at 1/26/21, 9:20 AM: cc [~wangda] [~sunilg] 

[jira] [Updated] (YARN-10592) Support QueueCapacities to use vector based multi resource types, and update absolute related to use first.

2021-01-26 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10592: - Attachment: YARN-10592.002.patch > Support QueueCapacities to use vector based multi resource types, and update