[jira] [Created] (YARN-10592) Support QueueCapacities to use vector, and update absolute related to use first.

2021-01-25 Thread zhuqi (Jira)
zhuqi created YARN-10592: Summary: Support QueueCapacities to use vector, and update absolute related to use first. Key: YARN-10592 URL: https://issues.apache.org/jira/browse/YARN-10592 Project: Hadoop YARN

[jira] [Updated] (YARN-10592) Support QueueCapacities to use vector, and update absolute related to use first.

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10592: - Description: Because we need to support YARN-10524 and related other multi type support. We should support cap/a

[jira] [Updated] (YARN-10592) Support QueueCapacities to use vector, and update absolute related to use first.

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10592: - Description: Because we need to support YARN-10524 and related other multi type support. Support QueueCapacities

[jira] [Updated] (YARN-10592) Support QueueCapacities to use vector, and update absolute related to use first.

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10592: - Description: Because we need to support YARN-10524 and related other multi type support. Support QueueCapacities

[jira] [Commented] (YARN-10592) Support QueueCapacities to use vector, and update absolute related to use first.

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271183#comment-17271183 ] zhuqi commented on YARN-10592: -- cc [~leftnoteasy]  [~bteke]  [~gandras] Any thoughts about

[jira] [Comment Edited] (YARN-10592) Support QueueCapacities to use vector, and update absolute related to use first.

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271183#comment-17271183 ] zhuqi edited comment on YARN-10592 at 1/25/21, 9:16 AM: cc [~left

[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271186#comment-17271186 ] zhuqi commented on YARN-10531: -- Thanks [~wangda] for final review.   > Be able to disable

[jira] [Updated] (YARN-10576) Update Capacity Scheduler documentation about JSON-based placement mapping

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10576: Summary: Update Capacity Scheduler documentation about JSON-based placement mapping (was: Update C

[jira] [Commented] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-25 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271253#comment-17271253 ] Andras Gyori commented on YARN-10585: - Thank you [~shuzirra] for the patch! I have an

[jira] [Commented] (YARN-10564) Support Auto Queue Creation template configurations

2021-01-25 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271281#comment-17271281 ] Hadoop QA commented on YARN-10564: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-10592) Support QueueCapacities to use vector, and update absolute related to use first.

2021-01-25 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271289#comment-17271289 ] Hadoop QA commented on YARN-10592: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (YARN-10593) Fix incorrect string comparison in GpuDiscoverer

2021-01-25 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10593: --- Summary: Fix incorrect string comparison in GpuDiscoverer Key: YARN-10593 URL: https://issues.apache.org/jira/browse/YARN-10593 Project: Hadoop YARN Issue Type

[jira] [Commented] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-25 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271297#comment-17271297 ] Gergely Pollak commented on YARN-10585: --- [~gandras] thank you for the review and yo

[jira] [Comment Edited] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-25 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271297#comment-17271297 ] Gergely Pollak edited comment on YARN-10585 at 1/25/21, 1:01 PM: --

[jira] [Commented] (YARN-10593) Fix incorrect string comparison in GpuDiscoverer

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271298#comment-17271298 ] Peter Bacsko commented on YARN-10593: - Unfortunately, Zoltan Siegl's comment has not

[jira] [Commented] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

2021-01-25 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271305#comment-17271305 ] Hadoop QA commented on YARN-10559: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (YARN-10594) Split the debug log when execute privileged operation

2021-01-25 Thread Wanqiang Ji (Jira)
Wanqiang Ji created YARN-10594: -- Summary: Split the debug log when execute privileged operation Key: YARN-10594 URL: https://issues.apache.org/jira/browse/YARN-10594 Project: Hadoop YARN Issue T

[jira] [Created] (YARN-10595) Support config the AM-RM poll time in AMRMClient

2021-01-25 Thread Wanqiang Ji (Jira)
Wanqiang Ji created YARN-10595: -- Summary: Support config the AM-RM poll time in AMRMClient Key: YARN-10595 URL: https://issues.apache.org/jira/browse/YARN-10595 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Andras Gyori (Jira)
Andras Gyori created YARN-10596: --- Summary: Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled Key: YARN-10596 URL: https://issues.apache.org/jira/browse/YARN-10596 Pro

[jira] [Created] (YARN-10597) CSMappingPlacementRule should not create new instance of Groups

2021-01-25 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10597: - Summary: CSMappingPlacementRule should not create new instance of Groups Key: YARN-10597 URL: https://issues.apache.org/jira/browse/YARN-10597 Project: Hadoop YARN

[jira] [Assigned] (YARN-10597) CSMappingPlacementRule should not create new instance of Groups

2021-01-25 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak reassigned YARN-10597: - Assignee: Gergely Pollak > CSMappingPlacementRule should not create new instance of Grou

[jira] [Commented] (YARN-10425) Replace the legacy placement engine in CS with the new one

2021-01-25 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271331#comment-17271331 ] Gergely Pollak commented on YARN-10425: --- [~ahussein]Thank you for the feedback, I'v

[jira] [Commented] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271342#comment-17271342 ] Peter Bacsko commented on YARN-10596: - [~gandras] I have a question. {noformat} //

[jira] [Comment Edited] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271342#comment-17271342 ] Peter Bacsko edited comment on YARN-10596 at 1/25/21, 2:38 PM:

[jira] [Comment Edited] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271342#comment-17271342 ] Peter Bacsko edited comment on YARN-10596 at 1/25/21, 2:53 PM:

[jira] [Commented] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271355#comment-17271355 ] Peter Bacsko commented on YARN-10596: - Ok, I've just read this sentence: _Since it i

[jira] [Comment Edited] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271355#comment-17271355 ] Peter Bacsko edited comment on YARN-10596 at 1/25/21, 3:04 PM:

[jira] [Updated] (YARN-10592) Support QueueCapacities to use vector based multi resource types, and update absolute related to use first.

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10592: - Summary: Support QueueCapacities to use vector based multi resource types, and update absolute related to use fir

[jira] [Commented] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-25 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271371#comment-17271371 ] Benjamin Teke commented on YARN-10585: -- Thank [~shuzirra] for working on this. Based

[jira] [Comment Edited] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-25 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271371#comment-17271371 ] Benjamin Teke edited comment on YARN-10585 at 1/25/21, 3:34 PM: ---

[jira] [Commented] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271405#comment-17271405 ] zhuqi commented on YARN-10585: -- Thank [~shuzirra] for working on this. The latest  patch LGT

[jira] [Commented] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271419#comment-17271419 ] Benjamin Teke commented on YARN-10596: -- [~gandras] thanks for the patch. I have a su

[jira] [Commented] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271563#comment-17271563 ] Hadoop QA commented on YARN-10596: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Resolved] (YARN-10164) Allow NM to start even when custom resource type not defined

2021-01-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne resolved YARN-10164. --- Resolution: Won't Do > Allow NM to start even when custom resource type not defined > ---

[jira] [Comment Edited] (YARN-10592) Support QueueCapacities to use vector based multi resource types, and update absolute related to use first.

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271183#comment-17271183 ] zhuqi edited comment on YARN-10592 at 1/26/21, 2:21 AM: cc [~wang

[jira] [Comment Edited] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation loss.

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269888#comment-17269888 ] zhuqi edited comment on YARN-10590 at 1/26/21, 2:22 AM: cc [~wang