[jira] [Updated] (YARN-10770) container-executor permission is wrong in SecureContainer.md

2021-05-24 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Ahuja updated YARN-10770: --- Attachment: (was: YARN-10770.001.patch) > container-executor permission is wrong in

[jira] [Updated] (YARN-10770) container-executor permission is wrong in SecureContainer.md

2021-05-24 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Ahuja updated YARN-10770: --- Attachment: YARN-10770.001.patch > container-executor permission is wrong in

[jira] [Created] (YARN-10785) Yarn NodeManager aux-services should support trim.

2021-05-24 Thread Qi Zhu (Jira)
Qi Zhu created YARN-10785: - Summary: Yarn NodeManager aux-services should support trim. Key: YARN-10785 URL: https://issues.apache.org/jira/browse/YARN-10785 Project: Hadoop YARN Issue Type: Bug

[jira] [Assigned] (YARN-10770) container-executor permission is wrong in SecureContainer.md

2021-05-24 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Ahuja reassigned YARN-10770: -- Assignee: Siddharth Ahuja > container-executor permission is wrong in

[jira] [Commented] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

2021-05-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350482#comment-17350482 ] Qi Zhu commented on YARN-10771: --- Thanks [~chaosju] for contribution and [~pbacsko] for review. The test is

[jira] [Commented] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

2021-05-24 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350396#comment-17350396 ] Hadoop QA commented on YARN-10771: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-10784) Optimize RMNodeStatusEvent process performance

2021-05-24 Thread chaosju (Jira)
[ https://issues.apache.org/jira/browse/YARN-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaosju resolved YARN-10784. Fix Version/s: 3.3.0 Resolution: Fixed > Optimize RMNodeStatusEvent process performance >

[jira] [Updated] (YARN-10784) Optimize RMNodeStatusEvent process performance

2021-05-24 Thread chaosju (Jira)
[ https://issues.apache.org/jira/browse/YARN-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaosju updated YARN-10784: --- Affects Version/s: 2.8.5 > Optimize RMNodeStatusEvent process performance >

[jira] [Updated] (YARN-10784) Optimize RMNodeStatusEvent process performance

2021-05-24 Thread chaosju (Jira)
[ https://issues.apache.org/jira/browse/YARN-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaosju updated YARN-10784: --- Description: According to YARN-9927 analysis. The RMNodeStatusEvent dominates 90% time consumption of RM

[jira] [Updated] (YARN-10784) Optimize RMNodeStatusEvent process performance

2021-05-24 Thread chaosju (Jira)
[ https://issues.apache.org/jira/browse/YARN-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaosju updated YARN-10784: --- Attachment: (was: screenshot-1.png) > Optimize RMNodeStatusEvent process performance >

[jira] [Updated] (YARN-10784) Optimize RMNodeStatusEvent process performance

2021-05-24 Thread chaosju (Jira)
[ https://issues.apache.org/jira/browse/YARN-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaosju updated YARN-10784: --- Attachment: screenshot-2.png > Optimize RMNodeStatusEvent process performance >

[jira] [Updated] (YARN-10784) Optimize RMNodeStatusEvent process performance

2021-05-24 Thread chaosju (Jira)
[ https://issues.apache.org/jira/browse/YARN-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaosju updated YARN-10784: --- Description: According to YARN-9927 analysis. The RMNodeStatusEvent dominates 90% time consumption of RM

[jira] [Created] (YARN-10784) Optimize RMNodeStatusEvent process performance

2021-05-24 Thread chaosju (Jira)
chaosju created YARN-10784: -- Summary: Optimize RMNodeStatusEvent process performance Key: YARN-10784 URL: https://issues.apache.org/jira/browse/YARN-10784 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-10784) Optimize RMNodeStatusEvent process performance

2021-05-24 Thread chaosju (Jira)
[ https://issues.apache.org/jira/browse/YARN-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaosju updated YARN-10784: --- Attachment: screenshot-1.png > Optimize RMNodeStatusEvent process performance >

[jira] [Commented] (YARN-10324) Fetch data from NodeManager may case read timeout when disk is busy

2021-05-24 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350370#comment-17350370 ] Hadoop QA commented on YARN-10324: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10324) Fetch data from NodeManager may case read timeout when disk is busy

2021-05-24 Thread Yao Guangdong (Jira)
[ https://issues.apache.org/jira/browse/YARN-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yao Guangdong updated YARN-10324: - Attachment: YARN-10324.003.patch > Fetch data from NodeManager may case read timeout when disk

[jira] [Updated] (YARN-10324) Fetch data from NodeManager may case read timeout when disk is busy

2021-05-24 Thread Yao Guangdong (Jira)
[ https://issues.apache.org/jira/browse/YARN-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yao Guangdong updated YARN-10324: - Attachment: (was: YARN-10324.003.patch) > Fetch data from NodeManager may case read timeout

[jira] [Commented] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

2021-05-24 Thread chaosju (Jira)
[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350296#comment-17350296 ] chaosju commented on YARN-10771: thanks [~pbacsko][~zhuqi] for review, updated a new patch-005. > Add

[jira] [Updated] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

2021-05-24 Thread chaosju (Jira)
[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaosju updated YARN-10771: --- Attachment: YARN-10771.005.patch > Add cluster metric for size of SchedulerEventQueue and RMEventQueue >

[jira] [Commented] (YARN-10781) The Thread of the NM aggregate log is exhausted and no other Application can aggregate the log

2021-05-24 Thread Xiping Zhang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350276#comment-17350276 ] Xiping Zhang commented on YARN-10781: - [~zhuqi]  Thank you for your reply. NM instantiates

[jira] [Updated] (YARN-10781) The Thread of the NM aggregate log is exhausted and no other Application can aggregate the log

2021-05-24 Thread Xiping Zhang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang updated YARN-10781: Attachment: containers.png > The Thread of the NM aggregate log is exhausted and no other

[jira] [Updated] (YARN-10781) The Thread of the NM aggregate log is exhausted and no other Application can aggregate the log

2021-05-24 Thread Xiping Zhang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang updated YARN-10781: Attachment: applications.png > The Thread of the NM aggregate log is exhausted and no other

[jira] [Updated] (YARN-10781) The Thread of the NM aggregate log is exhausted and no other Application can aggregate the log

2021-05-24 Thread Xiping Zhang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang updated YARN-10781: Attachment: containers.png > The Thread of the NM aggregate log is exhausted and no other

[jira] [Comment Edited] (YARN-10781) The Thread of the NM aggregate log is exhausted and no other Application can aggregate the log

2021-05-24 Thread Xiping Zhang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350226#comment-17350226 ] Xiping Zhang edited comment on YARN-10781 at 5/24/21, 7:00 AM: --- Aggregated

[jira] [Commented] (YARN-10783) Allow definition of auto queue template properties in root

2021-05-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350262#comment-17350262 ] Qi Zhu commented on YARN-10783: --- Thanks [~gandras] for this. The patch LGTM +1. > Allow definition of

[jira] [Comment Edited] (YARN-10781) The Thread of the NM aggregate log is exhausted and no other Application can aggregate the log

2021-05-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350255#comment-17350255 ] Qi Zhu edited comment on YARN-10781 at 5/24/21, 6:02 AM: - [~zhangxiping] It only

[jira] [Commented] (YARN-10781) The Thread of the NM aggregate log is exhausted and no other Application can aggregate the log

2021-05-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350255#comment-17350255 ] Qi Zhu commented on YARN-10781: --- [~zhangxiping] It only init app and create the thread pool, when AM