[jira] [Updated] (YARN-8477) Minor code refactor on ProcfsBasedProcessTree.java

2018-06-28 Thread Shuai Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuai Zhang updated YARN-8477: -- Attachment: YARN-8477.002.patch > Minor code refactor on ProcfsBasedProcessTree.java > -

[jira] [Created] (YARN-8480) Add boolean option for resources

2018-06-28 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-8480: -- Summary: Add boolean option for resources Key: YARN-8480 URL: https://issues.apache.org/jira/browse/YARN-8480 Project: Hadoop YARN Issue Type: Improvemen

[jira] [Updated] (YARN-8479) The capacity scheduler logs too frequently seriously affecting performance

2018-06-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-8479: -- Attachment: image-2018-06-29-14-16-06-332.png > The capacity scheduler logs too frequently seriously aff

[jira] [Updated] (YARN-8479) The capacity scheduler logs too frequently seriously affecting performance

2018-06-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-8479: -- Description: The capacity scheduler logs too frequently, seriously affecting performance. As a result o

[jira] [Updated] (YARN-8479) The capacity scheduler logs too frequently seriously affecting performance

2018-06-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-8479: -- Description: The capacity scheduler logs too frequently, seriously affecting performance. As a result o

[jira] [Updated] (YARN-8479) The capacity scheduler logs too frequently seriously affecting performance

2018-06-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-8479: -- Description: The capacity scheduler logs too frequently, seriously affecting performance. As a result o

[jira] [Assigned] (YARN-8479) The capacity scheduler logs too frequently seriously affecting performance

2018-06-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou reassigned YARN-8479: - Assignee: YunFan Zhou > The capacity scheduler logs too frequently seriously affecting performanc

[jira] [Created] (YARN-8479) The capacity scheduler logs too frequently seriously affecting performance

2018-06-28 Thread YunFan Zhou (JIRA)
YunFan Zhou created YARN-8479: - Summary: The capacity scheduler logs too frequently seriously affecting performance Key: YARN-8479 URL: https://issues.apache.org/jira/browse/YARN-8479 Project: Hadoop YARN

[jira] [Updated] (YARN-8478) The capacity scheduler logs too frequently seriously affecting performance

2018-06-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-8478: -- Summary: The capacity scheduler logs too frequently seriously affecting performance (was: The capacity

[jira] [Updated] (YARN-8478) The capacity scheduler logs too frequently, seriously affecting performance

2018-06-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-8478: -- Description: The capacity scheduler logs too frequently, seriously affecting performance. As a result o

[jira] [Assigned] (YARN-8478) The capacity scheduler logs too frequently seriously affecting performance

2018-06-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou reassigned YARN-8478: - Assignee: YunFan Zhou > The capacity scheduler logs too frequently seriously affecting performanc

[jira] [Commented] (YARN-8455) Add basic acl check for all TS v2 REST APIs

2018-06-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527231#comment-16527231 ] genericqa commented on YARN-8455: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-8478) The capacity scheduler logs too frequently, seriously affecting performance

2018-06-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-8478: -- Attachment: image-2018-06-29-14-08-50-981.png > The capacity scheduler logs too frequently, seriously af

[jira] [Created] (YARN-8478) The capacity scheduler logs too frequently, seriously affecting performance

2018-06-28 Thread YunFan Zhou (JIRA)
YunFan Zhou created YARN-8478: - Summary: The capacity scheduler logs too frequently, seriously affecting performance Key: YARN-8478 URL: https://issues.apache.org/jira/browse/YARN-8478 Project: Hadoop YAR

[jira] [Commented] (YARN-8467) AsyncDispatcher should have a name & display it in logs to improve debug

2018-06-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527221#comment-16527221 ] genericqa commented on YARN-8467: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-8477) Minor code refactor on ProcfsBasedProcessTree.java

2018-06-28 Thread Shuai Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuai Zhang updated YARN-8477: -- Attachment: YARN-8477.001.patch > Minor code refactor on ProcfsBasedProcessTree.java > -

[jira] [Created] (YARN-8477) Minor code refactor on ProcfsBasedProcessTree.java

2018-06-28 Thread Shuai Zhang (JIRA)
Shuai Zhang created YARN-8477: - Summary: Minor code refactor on ProcfsBasedProcessTree.java Key: YARN-8477 URL: https://issues.apache.org/jira/browse/YARN-8477 Project: Hadoop YARN Issue Type: Im

[jira] [Updated] (YARN-8467) AsyncDispatcher should have a name & display it in logs to improve debug

2018-06-28 Thread Shuai Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuai Zhang updated YARN-8467: -- Attachment: YARN-8467.002.patch > AsyncDispatcher should have a name & display it in logs to improve deb

[jira] [Resolved] (YARN-8476) Should check the resource of assignment is greater than Resources.none() before submitResourceCommitRequest

2018-06-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou resolved YARN-8476. --- Resolution: Won't Fix > Should check the resource of assignment is greater than Resources.none() > be

[jira] [Updated] (YARN-8476) Should check the resource of assignment is greater than Resources.none() before submitResourceCommitRequest

2018-06-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-8476: -- Description: (was: Hi, [~leftnoteasy] We recently merge https://issues.apache.org/jira/browse/YARN-5

[jira] [Updated] (YARN-8476) Should check the resource of assignment is greater than Resources.none() before submitResourceCommitRequest

2018-06-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-8476: -- Priority: Minor (was: Blocker) > Should check the resource of assignment is greater than Resources.none

[jira] [Updated] (YARN-8476) Should check the resource of assignment is greater than Resources.none() before submitResourceCommitRequest

2018-06-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-8476: -- Description: Hi, [~leftnoteasy] We recently merge https://issues.apache.org/jira/browse/YARN-5139 into

[jira] [Updated] (YARN-8476) Should check the resource of assignment is greater than Resources.none() before submitResourceCommitRequest

2018-06-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-8476: -- Description: Hi, [~leftnoteasy] We recently merge https://issues.apache.org/jira/browse/YARN-5139 into

[jira] [Updated] (YARN-8455) Add basic acl check for all TS v2 REST APIs

2018-06-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-8455: Attachment: YARN-8455.004.patch > Add basic acl check for all TS v2 REST APIs >

[jira] [Created] (YARN-8476) Should check the resource of assignment is greater than Resources.none() before submitResourceCommitRequest

2018-06-28 Thread YunFan Zhou (JIRA)
YunFan Zhou created YARN-8476: - Summary: Should check the resource of assignment is greater than Resources.none() before submitResourceCommitRequest Key: YARN-8476 URL: https://issues.apache.org/jira/browse/YARN-8476

[jira] [Created] (YARN-8475) Should check the resource of assignment is greater than Resources.none() before submitResourceCommitRequest

2018-06-28 Thread JackZhou (JIRA)
JackZhou created YARN-8475: -- Summary: Should check the resource of assignment is greater than Resources.none() before submitResourceCommitRequest Key: YARN-8475 URL: https://issues.apache.org/jira/browse/YARN-8475

[jira] [Commented] (YARN-8474) sleeper service fails to launch with "Authentication Required"

2018-06-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527148#comment-16527148 ] genericqa commented on YARN-8474: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (YARN-8471) YARN RM hangs and stops allocating resources when applications successively running

2018-06-28 Thread tianjuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527118#comment-16527118 ] tianjuan edited comment on YARN-8471 at 6/29/18 3:17 AM: - yes, it'

[jira] [Commented] (YARN-8471) YARN RM hangs and stops allocating resources when applications successively running

2018-06-28 Thread tianjuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527118#comment-16527118 ] tianjuan commented on YARN-8471: yes, it's related to YARN-8193.   this is a applicable pa

[jira] [Assigned] (YARN-8474) sleeper service fails to launch with "Authentication Required"

2018-06-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-8474: --- Assignee: Eric Yang Affects Version/s: 3.1.0 Target Version/s: 3.2.0, 3.1.1 - Fix K

[jira] [Updated] (YARN-8474) sleeper service fails to launch with "Authentication Required"

2018-06-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8474: Attachment: YARN-8474.001.patch > sleeper service fails to launch with "Authentication Required" > -

[jira] [Commented] (YARN-8455) Add basic acl check for all TS v2 REST APIs

2018-06-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527047#comment-16527047 ] genericqa commented on YARN-8455: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8455) Add basic acl check for all TS v2 REST APIs

2018-06-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527000#comment-16527000 ] Rohith Sharma K S commented on YARN-8455: - While testing I found one of the REST q

[jira] [Updated] (YARN-8455) Add basic acl check for all TS v2 REST APIs

2018-06-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-8455: Attachment: YARN-8455.003.patch > Add basic acl check for all TS v2 REST APIs >

[jira] [Updated] (YARN-8474) sleeper service fails to launch with "Authentication Required"

2018-06-28 Thread Sumana Sathish (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumana Sathish updated YARN-8474: - Description: Sleeper job fails with Authentication required. {code} yarn app -launch sl1 a/YarnSe

[jira] [Created] (YARN-8474) sleeper service fails to launch with "Authentication Required"

2018-06-28 Thread Sumana Sathish (JIRA)
Sumana Sathish created YARN-8474: Summary: sleeper service fails to launch with "Authentication Required" Key: YARN-8474 URL: https://issues.apache.org/jira/browse/YARN-8474 Project: Hadoop YARN

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-06-28 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526965#comment-16526965 ] Sunil Govindan commented on YARN-7863: -- Attaching first version for this patch. I wil

[jira] [Updated] (YARN-7863) Modify placement constraints to support node attributes

2018-06-28 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-7863: - Attachment: YARN-7863.v0.patch > Modify placement constraints to support node attributes > ---

[jira] [Commented] (YARN-1013) CS should watch resource utilization of containers and allocate speculative containers if appropriate

2018-06-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526926#comment-16526926 ] Haibo Chen commented on YARN-1013: -- {quote} where is the enforcement flag? {quote} It is

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-06-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526924#comment-16526924 ] Yufei Gu commented on YARN-8468: Sounds good to me. Thanks [~mrbillau]. > Limit container

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-06-28 Thread Mike Billau (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526900#comment-16526900 ] Mike Billau commented on YARN-8468: --- Hi [~yufeigu], [~bsteinbach], and team - sorry for

[jira] [Commented] (YARN-8471) YARN RM hangs and stops allocating resources when applications successively running

2018-06-28 Thread Xiao Liang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526881#comment-16526881 ] Xiao Liang commented on YARN-8471: -- Thanks [~jutia], is it related to YARN-8193 ? > YARN

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-06-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526869#comment-16526869 ] Yufei Gu commented on YARN-8468: [~bsteinbach] since you filed this jira and provided the

[jira] [Commented] (YARN-8473) Containers being launched as app tears down can leave containers in NEW state

2018-06-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526815#comment-16526815 ] Jason Lowe commented on YARN-8473: -- Sample error transitions from the NM log: {noformat}

[jira] [Created] (YARN-8473) Containers being launched as app tears down can leave containers in NEW state

2018-06-28 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-8473: Summary: Containers being launched as app tears down can leave containers in NEW state Key: YARN-8473 URL: https://issues.apache.org/jira/browse/YARN-8473 Project: Hadoop YAR

[jira] [Commented] (YARN-8451) Multiple NM heartbeat thread created when a slow NM resync with RM

2018-06-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526745#comment-16526745 ] genericqa commented on YARN-8451: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-8451) Multiple NM heartbeat thread created when a slow NM resync with RM

2018-06-28 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526655#comment-16526655 ] Botong Huang commented on YARN-8451: Good point, fixed in v2 patch! > Multiple NM hea

[jira] [Updated] (YARN-8451) Multiple NM heartbeat thread created when a slow NM resync with RM

2018-06-28 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8451: --- Attachment: YARN-8451.v2.patch > Multiple NM heartbeat thread created when a slow NM resync with RM >

[jira] [Commented] (YARN-8451) Multiple NM heartbeat thread created when a slow NM resync with RM

2018-06-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526650#comment-16526650 ] Jason Lowe commented on YARN-8451: -- Ah, sorry, I missed that there was a thread earlier a

[jira] [Commented] (YARN-8451) Multiple NM heartbeat thread created when a slow NM resync with RM

2018-06-28 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526640#comment-16526640 ] Botong Huang commented on YARN-8451: Hi [~jlowe], I am actually not changing this beha

[jira] [Commented] (YARN-8453) Additional Unit tests to verify queue limit and max-limit with multiple resource types

2018-06-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526621#comment-16526621 ] Wangda Tan commented on YARN-8453: -- +1 to the patch, thanks [~sunilg]. > Additional Unit

[jira] [Commented] (YARN-8379) Improve balancing resources in already satisfied queues by using Capacity Scheduler preemption

2018-06-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526603#comment-16526603 ] Hudson commented on YARN-8379: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #144

[jira] [Updated] (YARN-8472) YARN Container Phase 2

2018-06-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8472: Description: In YARN-3611, we have implemented basic Docker container support for YARN.  This story is the

[jira] [Created] (YARN-8472) YARN Container Phase 2

2018-06-28 Thread Eric Yang (JIRA)
Eric Yang created YARN-8472: --- Summary: YARN Container Phase 2 Key: YARN-8472 URL: https://issues.apache.org/jira/browse/YARN-8472 Project: Hadoop YARN Issue Type: Improvement Reporter:

[jira] [Commented] (YARN-8455) Add basic acl check for all TS v2 REST APIs

2018-06-28 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526586#comment-16526586 ] Sunil Govindan commented on YARN-8455: -- Latest patch looks good to me. +1 Committing

[jira] [Updated] (YARN-8379) Improve balancing resources in already satisfied queues by using Capacity Scheduler preemption

2018-06-28 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8379: - Summary: Improve balancing resources in already satisfied queues by using Capacity Scheduler preem

[jira] [Commented] (YARN-8409) ActiveStandbyElectorBasedElectorService is failing with NPE

2018-06-28 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526578#comment-16526578 ] Chandni Singh commented on YARN-8409: - Thanks [~eyang] for reviewing and merging the p

[jira] [Commented] (YARN-8378) Missing default implementation of loading application with FileSystemApplicationHistoryStore

2018-06-28 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526570#comment-16526570 ] Sunil Govindan commented on YARN-8378: -- Changes seems fine to me. [~rohithsharma] cou

[jira] [Commented] (YARN-8409) ActiveStandbyElectorBasedElectorService is failing with NPE

2018-06-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526561#comment-16526561 ] Hudson commented on YARN-8409: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #144

[jira] [Resolved] (YARN-8414) Nodemanager crashes soon if ATSv2 HBase is either down or absent

2018-06-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang resolved YARN-8414. - Resolution: Cannot Reproduce This has not happened in the last two weeks of stress test.  Close this as ca

[jira] [Commented] (YARN-7690) Expose reserved Memory/Vcores of Node Manager at WebUI

2018-06-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526550#comment-16526550 ] genericqa commented on YARN-7690: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7690) Expose reserved Memory/Vcores of Node Manager at WebUI

2018-06-28 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526505#comment-16526505 ] Íñigo Goiri commented on YARN-7690: --- Thanks [~jutia] for the patch. Can you add unit tes

[jira] [Updated] (YARN-7690) Expose reserved Memory/Vcores of Node Manager at WebUI

2018-06-28 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-7690: -- Description: Now only total reserved memory/Vcores are exposed at RM Web UI, reserved memory/Vcores of a

[jira] [Commented] (YARN-8471) YARN RM hangs and stops allocating resources when applications successively running

2018-06-28 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526499#comment-16526499 ] Íñigo Goiri commented on YARN-8471: --- Can you also post the stack traces and describe how

[jira] [Assigned] (YARN-7690) Expose reserved Memory/Vcores of Node Manager at WebUI

2018-06-28 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned YARN-7690: - Assignee: tianjuan > Expose reserved Memory/Vcores of Node Manager at WebUI > ---

[jira] [Updated] (YARN-7690) Expose reserved Memory/Vcores of Node Manager at WebUI

2018-06-28 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-7690: -- Summary: Expose reserved Memory/Vcores of Node Manager at WebUI (was: expose reserved memory/Vcores of

[jira] [Commented] (YARN-8409) ActiveStandbyElectorBasedElectorService is failing with NPE

2018-06-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526497#comment-16526497 ] Eric Yang commented on YARN-8409: - [~csingh] Thank you for the patch.  TestAppManager erro

[jira] [Assigned] (YARN-8471) YARN RM hangs and stops allocating resources when applications successively running

2018-06-28 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned YARN-8471: - Assignee: tianjuan > YARN RM hangs and stops allocating resources when applications successively

[jira] [Commented] (YARN-8471) YARN RM hangs and stops allocating resources when applications successively running

2018-06-28 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526496#comment-16526496 ] Íñigo Goiri commented on YARN-8471: --- Thanks [~jutia] for the patch, does this apply to t

[jira] [Updated] (YARN-8471) YARN RM hangs and stops allocating resources when applications successively running

2018-06-28 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-8471: -- Description: At some point RM just hangs and stops allocating resources. At the point RM get hangs, YARN

[jira] [Commented] (YARN-8103) Add CLI interface to query node attributes

2018-06-28 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526412#comment-16526412 ] Bibin A Chundatt commented on YARN-8103: Thank you [~Naganarasimha] for review and

[jira] [Commented] (YARN-8459) Improve logs of Capacity Scheduler to better debug invalid states

2018-06-28 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526393#comment-16526393 ] Bibin A Chundatt commented on YARN-8459: [~leftnoteasy] Can we remove the Capacit

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-06-28 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526350#comment-16526350 ] Antal Bálint Steinbach commented on YARN-8468: -- [~szegedim], "yarn.scheduler.

[jira] [Commented] (YARN-8451) Multiple NM heartbeat thread created when a slow NM resync with RM

2018-06-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526343#comment-16526343 ] Jason Lowe commented on YARN-8451: -- Thanks for the report and patch! Are we sure it's sa

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-06-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526331#comment-16526331 ] genericqa commented on YARN-8468: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-06-28 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526328#comment-16526328 ] Manikandan R commented on YARN-4606: [~eepayne] Thank you for great explanation. I am

[jira] [Commented] (YARN-8467) AsyncDispatcher should have a name & display it in logs to improve debug

2018-06-28 Thread Shuai Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526178#comment-16526178 ] Shuai Zhang commented on YARN-8467: --- Because it's just related to debug logs, there's no

[jira] [Commented] (YARN-8378) Missing default implementation of loading application with FileSystemApplicationHistoryStore

2018-06-28 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526165#comment-16526165 ] Lantao Jin commented on YARN-8378: -- [~sunilg] Could you have a time to review? > Missing

[jira] [Updated] (YARN-8471) YARN RM hangs and stops allocating resources when applications successively running

2018-06-28 Thread tianjuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tianjuan updated YARN-8471: --- Affects Version/s: 2.9.0 > YARN RM hangs and stops allocating resources when applications successively > runn

[jira] [Commented] (YARN-8471) YARN RM hangs and stops allocating resources when applications successively running

2018-06-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526071#comment-16526071 ] genericqa commented on YARN-8471: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-8471) YARN RM hangs and stops allocating resources when applications successively running

2018-06-28 Thread tianjuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tianjuan updated YARN-8471: --- Summary: YARN RM hangs and stops allocating resources when applications successively running (was: YARN throw

[jira] [Created] (YARN-8471) YARN throw NullPointerException at RegularContainerAllocator

2018-06-28 Thread tianjuan (JIRA)
tianjuan created YARN-8471: -- Summary: YARN throw NullPointerException at RegularContainerAllocator Key: YARN-8471 URL: https://issues.apache.org/jira/browse/YARN-8471 Project: Hadoop YARN Issue Typ

[jira] [Commented] (YARN-8435) NPE when the same client simultaneously contact for the first time Yarn Router

2018-06-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526017#comment-16526017 ] genericqa commented on YARN-8435: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote