[jira] [Commented] (YARN-3979) Am in ResourceLocalizationService hang 10 min cause RM kill AM

2015-07-30 Thread zhangyubiao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647303#comment-14647303 ] zhangyubiao commented on YARN-3979: --- I send you RM Logs just now > Am in ResourceLocali

[jira] [Commented] (YARN-3232) Some application states are not necessarily exposed to users

2015-07-30 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647315#comment-14647315 ] Varun Saxena commented on YARN-3232: [~jianhe], what about CLI ? I guess we should not

[jira] [Commented] (YARN-3232) Some application states are not necessarily exposed to users

2015-07-30 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647319#comment-14647319 ] Varun Saxena commented on YARN-3232: I mean RM can change these states while returning

[jira] [Commented] (YARN-3979) Am in ResourceLocalizationService hang 10 min cause RM kill AM

2015-07-30 Thread zhangyubiao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647358#comment-14647358 ] zhangyubiao commented on YARN-3979: --- And Today we find that Yarn Memory Reserved very Lar

[jira] [Updated] (YARN-3990) AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected

2015-07-30 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3990: --- Attachment: 0002-YARN-3990.patch Hi [~adhoot] . Was tricky. Attaching patch including testcase.

[jira] [Commented] (YARN-2768) Avoid cloning Resource in FSAppAttempt#updateDemand

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647447#comment-14647447 ] Hudson commented on YARN-2768: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1002 (See [https://

[jira] [Commented] (YARN-3919) NPEs' while stopping service after exception during CommonNodeLabelsManager#start

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647451#comment-14647451 ] Hudson commented on YARN-3919: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1002 (See [https://

[jira] [Commented] (YARN-3950) Add unique YARN_SHELL_ID environment variable to DistributedShell

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647449#comment-14647449 ] Hudson commented on YARN-3950: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1002 (See [https://

[jira] [Created] (YARN-3997) An Application requesting multiple core containers can't preempt running application made of single core containers

2015-07-30 Thread Dan Shechter (JIRA)
Dan Shechter created YARN-3997: -- Summary: An Application requesting multiple core containers can't preempt running application made of single core containers Key: YARN-3997 URL: https://issues.apache.org/jira/browse/

[jira] [Commented] (YARN-3950) Add unique YARN_SHELL_ID environment variable to DistributedShell

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647499#comment-14647499 ] Hudson commented on YARN-3950: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #272 (See [htt

[jira] [Commented] (YARN-3919) NPEs' while stopping service after exception during CommonNodeLabelsManager#start

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647501#comment-14647501 ] Hudson commented on YARN-3919: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #272 (See [htt

[jira] [Commented] (YARN-2768) Avoid cloning Resource in FSAppAttempt#updateDemand

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647497#comment-14647497 ] Hudson commented on YARN-2768: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #272 (See [htt

[jira] [Commented] (YARN-3990) AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected

2015-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647503#comment-14647503 ] Hadoop QA commented on YARN-3990: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3250) Support admin/user cli interface in for Application Priority

2015-07-30 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647507#comment-14647507 ] Rohith Sharma K S commented on YARN-3250: - bq. I think one problem is that if there

[jira] [Updated] (YARN-3857) Memory leak in ResourceManager with SIMPLE mode

2015-07-30 Thread mujunchao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mujunchao updated YARN-3857: Attachment: YARN-3857-3.patch fix the comments and format the code. > Memory leak in ResourceManager with SI

[jira] [Commented] (YARN-3857) Memory leak in ResourceManager with SIMPLE mode

2015-07-30 Thread mujunchao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647568#comment-14647568 ] mujunchao commented on YARN-3857: - thanks for your reviewing, have fixed the comments and t

[jira] [Commented] (YARN-3950) Add unique YARN_SHELL_ID environment variable to DistributedShell

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647580#comment-14647580 ] Hudson commented on YARN-3950: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #261 (See [htt

[jira] [Commented] (YARN-3919) NPEs' while stopping service after exception during CommonNodeLabelsManager#start

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647582#comment-14647582 ] Hudson commented on YARN-3919: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #261 (See [htt

[jira] [Commented] (YARN-2768) Avoid cloning Resource in FSAppAttempt#updateDemand

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647578#comment-14647578 ] Hudson commented on YARN-2768: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #261 (See [htt

[jira] [Commented] (YARN-3857) Memory leak in ResourceManager with SIMPLE mode

2015-07-30 Thread mujunchao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647585#comment-14647585 ] mujunchao commented on YARN-3857: - Thanks Devar for reviewing, 1. I think ClientToAMTokenSe

[jira] [Commented] (YARN-2768) Avoid cloning Resource in FSAppAttempt#updateDemand

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647692#comment-14647692 ] Hudson commented on YARN-2768: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2199 (See [https://

[jira] [Commented] (YARN-3950) Add unique YARN_SHELL_ID environment variable to DistributedShell

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647694#comment-14647694 ] Hudson commented on YARN-3950: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2199 (See [https://

[jira] [Updated] (YARN-3965) Add starup timestamp for nodemanager

2015-07-30 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Zhiguo updated YARN-3965: -- Attachment: YARN-3965-3.patch > Add starup timestamp for nodemanager > --

[jira] [Commented] (YARN-3919) NPEs' while stopping service after exception during CommonNodeLabelsManager#start

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647696#comment-14647696 ] Hudson commented on YARN-3919: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2199 (See [https://

[jira] [Commented] (YARN-3965) Add starup timestamp for nodemanager

2015-07-30 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647709#comment-14647709 ] Hong Zhiguo commented on YARN-3965: --- made it private with Getter. Hi, [~zxu], [~jlowe], c

[jira] [Commented] (YARN-3990) AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected

2015-07-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647743#comment-14647743 ] Jason Lowe commented on YARN-3990: -- Please look into the java and release audit warnings.

[jira] [Created] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2015-07-30 Thread Jun Gong (JIRA)
Jun Gong created YARN-3998: -- Summary: Add retry-times to let NM re-launch container when it fails to run Key: YARN-3998 URL: https://issues.apache.org/jira/browse/YARN-3998 Project: Hadoop YARN Iss

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2015-07-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647755#comment-14647755 ] Jason Lowe commented on YARN-3998: -- Is this really a feature that YARN needs to provide?

[jira] [Commented] (YARN-3919) NPEs' while stopping service after exception during CommonNodeLabelsManager#start

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647787#comment-14647787 ] Hudson commented on YARN-3919: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #269 (See

[jira] [Commented] (YARN-2768) Avoid cloning Resource in FSAppAttempt#updateDemand

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647783#comment-14647783 ] Hudson commented on YARN-2768: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #269 (See

[jira] [Commented] (YARN-3950) Add unique YARN_SHELL_ID environment variable to DistributedShell

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647785#comment-14647785 ] Hudson commented on YARN-3950: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #269 (See

[jira] [Commented] (YARN-3965) Add starup timestamp for nodemanager

2015-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647799#comment-14647799 ] Hadoop QA commented on YARN-3965: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3919) NPEs' while stopping service after exception during CommonNodeLabelsManager#start

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647828#comment-14647828 ] Hudson commented on YARN-3919: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2218 (See [htt

[jira] [Commented] (YARN-2768) Avoid cloning Resource in FSAppAttempt#updateDemand

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647824#comment-14647824 ] Hudson commented on YARN-2768: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2218 (See [htt

[jira] [Commented] (YARN-3950) Add unique YARN_SHELL_ID environment variable to DistributedShell

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647826#comment-14647826 ] Hudson commented on YARN-3950: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2218 (See [htt

[jira] [Updated] (YARN-1643) Make ContainersMonitor can support change monitoring size of an allocated container in NM side

2015-07-30 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1643: Attachment: YARN-1643-YARN-1197.7.patch Attaching latest patch which addressed the following: * Make {{tracki

[jira] [Commented] (YARN-3942) Timeline store to read events from HDFS

2015-07-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647873#comment-14647873 ] Jason Lowe commented on YARN-3942: -- I think so. We can probably create a new TimelineClie

[jira] [Assigned] (YARN-3997) An Application requesting multiple core containers can't preempt running application made of single core containers

2015-07-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-3997: -- Assignee: Karthik Kambatla (was: Arun Suresh) > An Application requesting multiple core

[jira] [Updated] (YARN-3997) An Application requesting multiple core containers can't preempt running application made of single core containers

2015-07-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3997: --- Assignee: Arun Suresh Target Version/s: 2.8.0 Priority: Critical (was:

[jira] [Updated] (YARN-3965) Add startup timestamp to nodemanager UI

2015-07-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-3965: - Target Version/s: 2.8.0 Summary: Add startup timestamp to nodemanager UI (was: Add starup tim

[jira] [Commented] (YARN-3963) AddNodeLabel on duplicate label addition shows success

2015-07-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647908#comment-14647908 ] Wangda Tan commented on YARN-3963: -- Looks good, committing.. > AddNodeLabel on duplicate

[jira] [Commented] (YARN-1643) Make ContainersMonitor can support change monitoring size of an allocated container in NM side

2015-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647916#comment-14647916 ] Hadoop QA commented on YARN-1643: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3887) Support for changing Application priority during runtime

2015-07-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3887: -- Attachment: 0003-YARN-3887.patch Thank you [~jianhe] and [~rohithsharma] for the comments. Updating a latest pat

[jira] [Commented] (YARN-3971) Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery

2015-07-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647920#comment-14647920 ] Wangda Tan commented on YARN-3971: -- Looks good, committing... will add some comment to the

[jira] [Updated] (YARN-3990) AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected

2015-07-30 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3990: --- Attachment: 0003-YARN-3990.patch [~jlowe] Thank you for your comments {quote} java and release

[jira] [Commented] (YARN-1643) Make ContainersMonitor can support change monitoring size of an allocated container in NM side

2015-07-30 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647926#comment-14647926 ] MENG DING commented on YARN-1643: - The failed test does not seem to be related. > Make Con

[jira] [Commented] (YARN-3963) AddNodeLabel on duplicate label addition shows success

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647931#comment-14647931 ] Hudson commented on YARN-3963: -- FAILURE: Integrated in Hadoop-trunk-Commit #8244 (See [https:

[jira] [Updated] (YARN-3971) Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery

2015-07-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3971: - Attachment: 0005-YARN-3971.patch Attached latest patch committed to trunk. > Skip RMNodeLabelsManager#chec

[jira] [Commented] (YARN-3971) Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery

2015-07-30 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647949#comment-14647949 ] Bibin A Chundatt commented on YARN-3971: Thanks [~leftnoteasy] for review and commi

[jira] [Commented] (YARN-3232) Some application states are not necessarily exposed to users

2015-07-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647957#comment-14647957 ] Jian He commented on YARN-3232: --- agree > Some application states are not necessarily exposed

[jira] [Commented] (YARN-3940) Application moveToQueue should check NodeLabel permission

2015-07-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647955#comment-14647955 ] Wangda Tan commented on YARN-3940: -- [~bibinchundatt], I took a look at the patch, it check

[jira] [Commented] (YARN-3971) Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery

2015-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647978#comment-14647978 ] Hudson commented on YARN-3971: -- SUCCESS: Integrated in Hadoop-trunk-Commit #8245 (See [https:

[jira] [Commented] (YARN-3887) Support for changing Application priority during runtime

2015-07-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647984#comment-14647984 ] Wangda Tan commented on YARN-3887: -- [~sunilg], I took a quick look at the patch, some comm

[jira] [Updated] (YARN-3978) Configurably turn off the saving of container info in Generic AHS

2015-07-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3978: - Attachment: YARN-3978.003.patch Version 003 of patch. > Configurably turn off the saving of container info

[jira] [Updated] (YARN-3868) ContainerManager recovery for container resizing

2015-07-30 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3868: Attachment: YARN-3868-YARN-1197.4.patch Attach latest patch since dependent patches are changed. > Container

[jira] [Commented] (YARN-3250) Support admin/user cli interface in for Application Priority

2015-07-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648029#comment-14648029 ] Sunil G commented on YARN-3250: --- Hi [~rohithsharma] and [~jianhe] Supporting the idea of havi

[jira] [Commented] (YARN-3945) maxApplicationsPerUser is wrongly calculated

2015-07-30 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648032#comment-14648032 ] Nathan Roberts commented on YARN-3945: -- bq. Though the class doc(ActiveUsersManager) a

[jira] [Updated] (YARN-3983) Make CapacityScheduler to easier extend application allocation logic

2015-07-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3983: - Attachment: YARN-3983.2.patch Thanks for comments, [~jianhe]. Addressed all comments except two: 1. move t

[jira] [Commented] (YARN-3942) Timeline store to read events from HDFS

2015-07-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648048#comment-14648048 ] Zhijie Shen commented on YARN-3942: --- Yeah, I prefer creating a TimelineEntityFileClient t

[jira] [Commented] (YARN-3942) Timeline store to read events from HDFS

2015-07-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648057#comment-14648057 ] Jason Lowe commented on YARN-3942: -- The logs are created based on app attempt. It helps a

[jira] [Commented] (YARN-3990) AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected

2015-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648069#comment-14648069 ] Hadoop QA commented on YARN-3990: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3887) Support for changing Application priority during runtime

2015-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648089#comment-14648089 ] Hadoop QA commented on YARN-3887: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3906) split the application table from the entity table

2015-07-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3906: -- Attachment: YARN-3906-YARN-2928.001.patch v.1 patch posted. The application table is nearly identical to

[jira] [Created] (YARN-3999) Add a timeout when drain the dispatcher

2015-07-30 Thread Jian He (JIRA)
Jian He created YARN-3999: - Summary: Add a timeout when drain the dispatcher Key: YARN-3999 URL: https://issues.apache.org/jira/browse/YARN-3999 Project: Hadoop YARN Issue Type: Bug Repor

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-07-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648125#comment-14648125 ] Li Lu commented on YARN-3906: - Thanks for the patch [~sjlee0]! I'll take a look at it this afte

[jira] [Commented] (YARN-3978) Configurably turn off the saving of container info in Generic AHS

2015-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648151#comment-14648151 ] Hadoop QA commented on YARN-3978: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648169#comment-14648169 ] Hadoop QA commented on YARN-3906: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3978) Configurably turn off the saving of container info in Generic AHS

2015-07-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648175#comment-14648175 ] Eric Payne commented on YARN-3978: -- {{checkstyle}} indicates that {{YarnConfiguration.java

[jira] [Commented] (YARN-3983) Make CapacityScheduler to easier extend application allocation logic

2015-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648178#comment-14648178 ] Hadoop QA commented on YARN-3983: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-07-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3049: -- Attachment: YARN-3049-YARN-2928.3.patch > [Storage Implementation] Implement storage reader interface to

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-07-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648218#comment-14648218 ] Zhijie Shen commented on YARN-3049: --- [~gtCarrera9], thanks for review. I've addressed mos

[jira] [Assigned] (YARN-3999) Add a timeout when drain the dispatcher

2015-07-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-3999: - Assignee: Jian He > Add a timeout when drain the dispatcher > --- > >

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-07-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648243#comment-14648243 ] Li Lu commented on YARN-3049: - Hi [~zjshen]! Some of my comments: bq. As I see a lot of argume

[jira] [Commented] (YARN-2923) Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup

2015-07-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648245#comment-14648245 ] Wangda Tan commented on YARN-2923: -- Thanks for updating, [~Naganarasimha]! Some comments:

[jira] [Updated] (YARN-2884) Proxying all AM-RM communications

2015-07-30 Thread Kishore Chaliparambil (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kishore Chaliparambil updated YARN-2884: Attachment: YARN-2884-V7.patch Fixed the javadoc warnings > Proxying all AM-RM commu

[jira] [Updated] (YARN-3906) split the application table from the entity table

2015-07-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3906: -- Attachment: YARN-3906-YARN-2928.002.patch v.2 patch posted. Fixed the whitespace. > split the applicati

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-07-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648328#comment-14648328 ] Sangjin Lee commented on YARN-3906: --- Yes, that's a good point. I don't think the conflict

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648336#comment-14648336 ] Hadoop QA commented on YARN-3049: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-07-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648359#comment-14648359 ] Li Lu commented on YARN-3906: - Hi [~sjlee0], I looked at the patch, and have one general questi

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-07-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648363#comment-14648363 ] Li Lu commented on YARN-3906: - ...fixing formatting problems... bq. Hi Sangjin Lee, I looked a

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648382#comment-14648382 ] Hadoop QA commented on YARN-3906: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Created] (YARN-4000) RM crashes with NPE if leaf queue becomes parent queue during restart

2015-07-30 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-4000: Summary: RM crashes with NPE if leaf queue becomes parent queue during restart Key: YARN-4000 URL: https://issues.apache.org/jira/browse/YARN-4000 Project: Hadoop YARN

[jira] [Commented] (YARN-4000) RM crashes with NPE if leaf queue becomes parent queue during restart

2015-07-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648416#comment-14648416 ] Jason Lowe commented on YARN-4000: -- Example stacktrace: {noformat} 2015-07-30 22:12:03,424

[jira] [Commented] (YARN-3945) maxApplicationsPerUser is wrongly calculated

2015-07-30 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648418#comment-14648418 ] Nathan Roberts commented on YARN-3945: -- Hi [~leftnoteasy]. Regarding minimum_user_limi

[jira] [Commented] (YARN-3984) Rethink event column key issue

2015-07-30 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648428#comment-14648428 ] Vrushali C commented on YARN-3984: -- Hi Zhijie, bq. the current query we want to support n

[jira] [Commented] (YARN-2884) Proxying all AM-RM communications

2015-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648431#comment-14648431 ] Hadoop QA commented on YARN-2884: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-07-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648457#comment-14648457 ] Zhijie Shen commented on YARN-3904: --- [~gtCarrera9], thanks for the patch. Bellow are my c

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-07-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648472#comment-14648472 ] Sangjin Lee commented on YARN-3906: --- bq. I've also noticed that the newly added Applicati

[jira] [Updated] (YARN-3999) Add a timeout when drain the dispatcher

2015-07-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3999: -- Attachment: YARN-3999.patch > Add a timeout when drain the dispatcher > --- >

[jira] [Commented] (YARN-3999) Add a timeout when drain the dispatcher

2015-07-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648484#comment-14648484 ] Jian He commented on YARN-3999: --- Uploaded a patch which adds the timeout on draining the disp

[jira] [Commented] (YARN-2005) Blacklisting support for scheduling AMs

2015-07-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648488#comment-14648488 ] Arun Suresh commented on YARN-2005: --- Thanks for the patch [~adhoot], Couple of comments:

[jira] [Commented] (YARN-3984) Rethink event column key issue

2015-07-30 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648491#comment-14648491 ] Vrushali C commented on YARN-3984: -- To reach a conclusion on this: If everyone/most folks

[jira] [Commented] (YARN-3984) Rethink event column key issue

2015-07-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648499#comment-14648499 ] Li Lu commented on YARN-3984: - Hi [~vrushalic], one quick question. I'm a little bit confused b

[jira] [Commented] (YARN-3984) Rethink event column key issue

2015-07-30 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648516#comment-14648516 ] Vrushali C commented on YARN-3984: -- If the query has the exact timestamp as well event id,

[jira] [Commented] (YARN-3984) Rethink event column key issue

2015-07-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648521#comment-14648521 ] Li Lu commented on YARN-3984: - Thanks! I think I'm leaning towards to eventid#inverse_event_tim

[jira] [Updated] (YARN-3906) split the application table from the entity table

2015-07-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3906: -- Attachment: YARN-3906-YARN-2928.003.patch v.3 Forgot to add the application table to the schema creation

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-07-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648530#comment-14648530 ] Li Lu commented on YARN-3906: - Thanks [~sjlee0] for the clarification! Yes, that's a pretty pai

[jira] [Updated] (YARN-3999) Add a timeout when drain the dispatcher

2015-07-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3999: -- Attachment: YARN-3999.patch > Add a timeout when drain the dispatcher > --- >

[jira] [Commented] (YARN-3984) Rethink event column key issue

2015-07-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648540#comment-14648540 ] Sangjin Lee commented on YARN-3984: --- To be clear, with the latter option, if we want to l

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648574#comment-14648574 ] Hadoop QA commented on YARN-3906: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

  1   2   >