[jira] [Commented] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

2021-02-01 Thread VADAGA ANANYO RAO (Jira)
[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276904#comment-17276904 ] VADAGA ANANYO RAO commented on YARN-10559: -- Hi [~epayne], thank you for your earlier response. 

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276902#comment-17276902 ] zhuqi commented on YARN-10532: -- [~wangda] [~gandras] Attached a new patch for review. Thanks. > Capacity

[jira] [Updated] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10532: - Attachment: YARN-10532.009.patch > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is

[jira] [Comment Edited] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276811#comment-17276811 ] zhuqi edited comment on YARN-10532 at 2/2/21, 5:40 AM: --- Thanks a lot for  

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276811#comment-17276811 ] zhuqi commented on YARN-10532: -- Thanks a lot for  [~gandras]  patient review, it make sense to me. # I used

[jira] [Updated] (YARN-10607) User environment is unable to prepend PATH when mapreduce.admin.user.env also sets PATH

2021-02-01 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-10607: --- Description: When using the tarball approach to ship relevant Hadoop jars to containers, it is

[jira] [Updated] (YARN-10607) User environment is unable to prepend PATH when mapreduce.admin.user.env also sets PATH

2021-02-01 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-10607: --- Description: When using the tarball approach to ship relevant Hadoop jars to containers, it is

[jira] [Created] (YARN-10607) User environment is unable to prepend PATH when mapreduce.admin.user.env also sets PATH

2021-02-01 Thread Eric Badger (Jira)
Eric Badger created YARN-10607: -- Summary: User environment is unable to prepend PATH when mapreduce.admin.user.env also sets PATH Key: YARN-10607 URL: https://issues.apache.org/jira/browse/YARN-10607

[jira] [Commented] (YARN-10605) Add queue-mappings-override.enable property in FS2CS conversions

2021-02-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276529#comment-17276529 ] Hadoop QA commented on YARN-10605: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10604) Support auto queue creation without mapping rules

2021-02-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276466#comment-17276466 ] Hadoop QA commented on YARN-10604: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10605) Add queue-mappings-override.enable property in FS2CS conversions

2021-02-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276465#comment-17276465 ] Hadoop QA commented on YARN-10605: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-01 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276450#comment-17276450 ] Andras Gyori commented on YARN-10532: - Hi [~zhuqi], thank you for the patch! I have analysed the

[jira] [Commented] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276427#comment-17276427 ] Hadoop QA commented on YARN-10589: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

2021-02-01 Thread VADAGA ANANYO RAO (Jira)
[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276425#comment-17276425 ] VADAGA ANANYO RAO commented on YARN-10559: -- [~epayne], thanks for catching this. This is a major

[jira] [Commented] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

2021-02-01 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276404#comment-17276404 ] Eric Payne commented on YARN-10559: --- [~ananyo_rao], sorry for the delay. I'm still reviewing the

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi edited comment on YARN-10589 at 2/1/21, 3:08 PM: --- Thanks for [~ztang]

[jira] [Updated] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10589: - Attachment: YARN-10589-002.patch > Improve logic of multi-node allocation >

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi edited comment on YARN-10589 at 2/1/21, 3:00 PM: --- Thanks for [~ztang]

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi edited comment on YARN-10589 at 2/1/21, 2:59 PM: --- Thanks for [~ztang]

[jira] [Commented] (YARN-10605) Add queue-mappings-override.enable property in FS2CS conversions

2021-02-01 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276380#comment-17276380 ] Andras Gyori commented on YARN-10605: - Thank you [~shuzirra] [~bteke] for the reviews, I have

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi edited comment on YARN-10589 at 2/1/21, 2:48 PM: --- Thanks for [~ztang]

[jira] [Updated] (YARN-10605) Add queue-mappings-override.enable property in FS2CS conversions

2021-02-01 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10605: Attachment: YARN-10605.002.patch > Add queue-mappings-override.enable property in FS2CS

[jira] [Updated] (YARN-10606) Add queue-mappings-override.enable property in FS2CS conversions

2021-02-01 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10606: Parent: (was: YARN-10496) Issue Type: Bug (was: Sub-task) > Add

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi edited comment on YARN-10589 at 2/1/21, 2:46 PM: --- Thanks for [~ztang]

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi edited comment on YARN-10589 at 2/1/21, 2:42 PM: --- Thanks for [~ztang]

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi edited comment on YARN-10589 at 2/1/21, 2:37 PM: --- Thanks for [~ztang]

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi edited comment on YARN-10589 at 2/1/21, 2:36 PM: --- [~ztang] [~tanu.ajmera] I

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi edited comment on YARN-10589 at 2/1/21, 2:35 PM: --- [~ztang] [~tanu.ajmera] I

[jira] [Commented] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi commented on YARN-10589: -- [~ztang] [~tanu.ajmera] I have reviewed the patch, i don't think the logic

[jira] [Commented] (YARN-10605) Add queue-mappings-override.enable property in FS2CS conversions

2021-02-01 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276356#comment-17276356 ] Benjamin Teke commented on YARN-10605: -- [~gandras] thanks for the patch. I have one minor nit about

[jira] [Commented] (YARN-10604) Support auto queue creation without mapping rules

2021-02-01 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276351#comment-17276351 ] Gergely Pollak commented on YARN-10604: --- [~gandras]thank you for the patch, LGTM+1 (Non-binding) >

[jira] [Commented] (YARN-10605) Add queue-mappings-override.enable property in FS2CS conversions

2021-02-01 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276347#comment-17276347 ] Gergely Pollak commented on YARN-10605: --- [~gandras]Thank you for the patch! The only thing I've

[jira] [Commented] (YARN-10604) Support auto queue creation without mapping rules

2021-02-01 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276344#comment-17276344 ] Benjamin Teke commented on YARN-10604: -- [~gandras] thanks for the patch. Looks good to me, +1

[jira] [Resolved] (YARN-10606) Add queue-mappings-override.enable property in FS2CS conversions

2021-02-01 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori resolved YARN-10606. - Resolution: Duplicate > Add queue-mappings-override.enable property in FS2CS conversions >

[jira] [Created] (YARN-10606) Add queue-mappings-override.enable property in FS2CS conversions

2021-02-01 Thread Andras Gyori (Jira)
Andras Gyori created YARN-10606: --- Summary: Add queue-mappings-override.enable property in FS2CS conversions Key: YARN-10606 URL: https://issues.apache.org/jira/browse/YARN-10606 Project: Hadoop YARN

[jira] [Updated] (YARN-10605) Add queue-mappings-override.enable property in FS2CS conversions

2021-02-01 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10605: Attachment: YARN-10605.001.patch > Add queue-mappings-override.enable property in FS2CS

[jira] [Assigned] (YARN-10605) Add queue-mappings-override.enable property in FS2CS conversions

2021-02-01 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori reassigned YARN-10605: --- Assignee: Andras Gyori > Add queue-mappings-override.enable property in FS2CS conversions >

[jira] [Created] (YARN-10605) Add queue-mappings-override.enable property in FS2CS conversions

2021-02-01 Thread Andras Gyori (Jira)
Andras Gyori created YARN-10605: --- Summary: Add queue-mappings-override.enable property in FS2CS conversions Key: YARN-10605 URL: https://issues.apache.org/jira/browse/YARN-10605 Project: Hadoop YARN

[jira] [Commented] (YARN-10604) Support auto queue creation without mapping rules

2021-02-01 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276317#comment-17276317 ] Andras Gyori commented on YARN-10604: - Uploaded a new patch with the corresponding test case. >

[jira] [Updated] (YARN-10604) Support auto queue creation without mapping rules

2021-02-01 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10604: Attachment: YARN-10604.001.patch > Support auto queue creation without mapping rules >

[jira] [Created] (YARN-10604) Support auto queue creation without mapping rules

2021-02-01 Thread Andras Gyori (Jira)
Andras Gyori created YARN-10604: --- Summary: Support auto queue creation without mapping rules Key: YARN-10604 URL: https://issues.apache.org/jira/browse/YARN-10604 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-10601) The Yarn client should use the UGI who created the Yarn client for obtaining a delegation token for the remote log dir

2021-02-01 Thread Daniel Fritsi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276236#comment-17276236 ] Daniel Fritsi commented on YARN-10601: -- [~gezapeti], [~asalamon74] do you have any insights on years

[jira] [Commented] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276170#comment-17276170 ] Zhankun Tang commented on YARN-10589: - [~zhuqi], could you please review Tanu's patch too? > Improve

[jira] [Commented] (YARN-10603) Failed to reinitialize for recovered container

2021-02-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276126#comment-17276126 ] Hadoop QA commented on YARN-10603: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||