[jira] [Commented] (YARN-2495) Allow admin specify labels in each NM (Distributed configuration)

2014-10-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179673#comment-14179673 ] Wangda Tan commented on YARN-2495: -- [~Naganarasimha], [~aw], let me first give you an over

[jira] [Updated] (YARN-2398) TestResourceTrackerOnHA crashes

2014-10-22 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2398: - Attachment: (was: TestResourceTrackerOnHA-output.txt) > TestResourceTrackerOnHA crashes > -

[jira] [Commented] (YARN-2398) TestResourceTrackerOnHA crashes

2014-10-22 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179797#comment-14179797 ] Tsuyoshi OZAWA commented on YARN-2398: -- Rohith, Wangda, yeah, thanks for your pointing

[jira] [Commented] (YARN-2681) Support bandwidth enforcement for containers while reading from HDFS

2014-10-22 Thread cntic (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179802#comment-14179802 ] cntic commented on YARN-2681: - Find the concept at http://www.hit.bme.hu/~do/papers/Enforcement

[jira] [Commented] (YARN-2721) Race condition: ZKRMStateStore retry logic may throw NodeExist exception

2014-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179831#comment-14179831 ] Hudson commented on YARN-2721: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #720 (See [https://b

[jira] [Commented] (YARN-2720) Windows: Wildcard classpath variables not expanded against resources contained in archives

2014-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179829#comment-14179829 ] Hudson commented on YARN-2720: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #720 (See [https://b

[jira] [Commented] (YARN-2709) Add retry for timeline client getDelegationToken method

2014-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179835#comment-14179835 ] Hudson commented on YARN-2709: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #720 (See [https://b

[jira] [Commented] (YARN-2715) Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set.

2014-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179832#comment-14179832 ] Hudson commented on YARN-2715: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #720 (See [https://b

[jira] [Commented] (YARN-90) NodeManager should identify failed disks becoming good again

2014-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-90?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179830#comment-14179830 ] Hudson commented on YARN-90: SUCCESS: Integrated in Hadoop-Yarn-trunk #720 (See [https://builds.

[jira] [Created] (YARN-2725) Adding retry requests about ZKRMStateStore

2014-10-22 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created YARN-2725: Summary: Adding retry requests about ZKRMStateStore Key: YARN-2725 URL: https://issues.apache.org/jira/browse/YARN-2725 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-2721) Race condition: ZKRMStateStore retry logic may throw NodeExist exception

2014-10-22 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179842#comment-14179842 ] Tsuyoshi OZAWA commented on YARN-2721: -- Good job, Jian. Created YARN-2725 for adding t

[jira] [Updated] (YARN-2725) Adding test cases of retrying requests about ZKRMStateStore

2014-10-22 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2725: - Summary: Adding test cases of retrying requests about ZKRMStateStore (was: Adding retry requests a

[jira] [Created] (YARN-2726) CapacityScheduler should explicitly log when an accessible label has no capacity

2014-10-22 Thread Phil D'Amore (JIRA)
Phil D'Amore created YARN-2726: -- Summary: CapacityScheduler should explicitly log when an accessible label has no capacity Key: YARN-2726 URL: https://issues.apache.org/jira/browse/YARN-2726 Project: Had

[jira] [Commented] (YARN-2692) ktutil test hanging on some machines/ktutil versions

2014-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179903#comment-14179903 ] Hudson commented on YARN-2692: -- FAILURE: Integrated in Hadoop-trunk-Commit #6310 (See [https:

[jira] [Commented] (YARN-2721) Race condition: ZKRMStateStore retry logic may throw NodeExist exception

2014-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179919#comment-14179919 ] Hudson commented on YARN-2721: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1909 (See [https://

[jira] [Commented] (YARN-2720) Windows: Wildcard classpath variables not expanded against resources contained in archives

2014-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179917#comment-14179917 ] Hudson commented on YARN-2720: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1909 (See [https://

[jira] [Commented] (YARN-2715) Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set.

2014-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179921#comment-14179921 ] Hudson commented on YARN-2715: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1909 (See [https://

[jira] [Commented] (YARN-90) NodeManager should identify failed disks becoming good again

2014-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-90?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179918#comment-14179918 ] Hudson commented on YARN-90: FAILURE: Integrated in Hadoop-Hdfs-trunk #1909 (See [https://builds

[jira] [Commented] (YARN-2709) Add retry for timeline client getDelegationToken method

2014-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179924#comment-14179924 ] Hudson commented on YARN-2709: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1909 (See [https://

[jira] [Updated] (YARN-2683) document registry config options

2014-10-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2683: - Attachment: YARN-2683-002.patch correct patch as applied to branch-2 > document registry config op

[jira] [Commented] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

2014-10-22 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179929#comment-14179929 ] Mit Desai commented on YARN-2724: - The problem here is due to calculation of file length be

[jira] [Assigned] (YARN-2726) CapacityScheduler should explicitly log when an accessible label has no capacity

2014-10-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-2726: --- Assignee: Naganarasimha G R > CapacityScheduler should explicitly log when an accessib

[jira] [Commented] (YARN-2700) TestSecureRMRegistryOperations failing on windows: auth problems

2014-10-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179953#comment-14179953 ] Steve Loughran commented on YARN-2700: -- logs {code} 2014-10-21 03:25:26,022 [NIOServer

[jira] [Commented] (YARN-2683) document registry config options

2014-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179958#comment-14179958 ] Hadoop QA commented on YARN-2683: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2681) Support bandwidth enforcement for containers while reading from HDFS

2014-10-22 Thread cntic (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cntic updated YARN-2681: Description: To read/write data from HDFS on data node, applications establise TCP/IP connections with the datanode.

[jira] [Updated] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

2014-10-22 Thread Remus Rusanu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Remus Rusanu updated YARN-2198: --- Attachment: YARN-2198.16.patch .16.patch rebased to current trunk and resolves the conflict from YARN-2

[jira] [Updated] (YARN-2681) Support bandwidth enforcement for containers while reading from HDFS

2014-10-22 Thread cntic (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cntic updated YARN-2681: Attachment: HADOOP-2681.patch - fix findbugs warnings - testing purpose: +TC class rate can be given by read H

[jira] [Updated] (YARN-2700) TestSecureRMRegistryOperations failing on windows: auth problems

2014-10-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2700: - Attachment: YARN-2700-001.patch Patch. The problem (as explained by Chris Nauroth) is that windows

[jira] [Commented] (YARN-2715) Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set.

2014-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180012#comment-14180012 ] Hudson commented on YARN-2715: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1934 (See [htt

[jira] [Commented] (YARN-90) NodeManager should identify failed disks becoming good again

2014-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-90?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180010#comment-14180010 ] Hudson commented on YARN-90: FAILURE: Integrated in Hadoop-Mapreduce-trunk #1934 (See [https://b

[jira] [Commented] (YARN-2721) Race condition: ZKRMStateStore retry logic may throw NodeExist exception

2014-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180011#comment-14180011 ] Hudson commented on YARN-2721: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1934 (See [htt

[jira] [Commented] (YARN-2720) Windows: Wildcard classpath variables not expanded against resources contained in archives

2014-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180009#comment-14180009 ] Hudson commented on YARN-2720: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1934 (See [htt

[jira] [Commented] (YARN-2709) Add retry for timeline client getDelegationToken method

2014-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180015#comment-14180015 ] Hudson commented on YARN-2709: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1934 (See [htt

[jira] [Commented] (YARN-2714) Localizer thread might stuck if NM is OOM

2014-10-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180042#comment-14180042 ] Ming Ma commented on YARN-2714: --- Thanks Zhihai for the information. Yes, setting the RPC time

[jira] [Updated] (YARN-2681) Support bandwidth enforcement for containers while reading from HDFS

2014-10-22 Thread cntic (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cntic updated YARN-2681: Attachment: yarn-site.xml 1) Configuration for testing HDFS Bandwidth Enforcement (yarn-site,xml) - Enable enforcemen

[jira] [Commented] (YARN-2681) Support bandwidth enforcement for containers while reading from HDFS

2014-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180047#comment-14180047 ] Hadoop QA commented on YARN-2681: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2647) Add yarn queue CLI to get queue info including labels of such queue

2014-10-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180061#comment-14180061 ] Sunil G commented on YARN-2647: --- Hi [~mayank_bansal] Sorry for the delay here, I have done s

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

2014-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180066#comment-14180066 ] Hadoop QA commented on YARN-2198: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2700) TestSecureRMRegistryOperations failing on windows: auth problems

2014-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180069#comment-14180069 ] Hadoop QA commented on YARN-2700: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2681) Support bandwidth enforcement for containers while reading from HDFS

2014-10-22 Thread cntic (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cntic updated YARN-2681: Attachment: yarn-site.xml.example > Support bandwidth enforcement for containers while reading from HDFS > --

[jira] [Updated] (YARN-2700) TestSecureRMRegistryOperations failing on windows: auth problems

2014-10-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated YARN-2700: Hadoop Flags: Reviewed +1 for the patch, pending Jenkins. Thanks for the fix, Steve. > TestSecureRM

[jira] [Updated] (YARN-2681) Support bandwidth enforcement for containers while reading from HDFS

2014-10-22 Thread cntic (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cntic updated YARN-2681: Attachment: (was: yarn-site.xml) > Support bandwidth enforcement for containers while reading from HDFS > ---

[jira] [Commented] (YARN-2700) TestSecureRMRegistryOperations failing on windows: auth problems

2014-10-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180086#comment-14180086 ] Chris Nauroth commented on YARN-2700: - bq. ...pending Jenkins... Never mind. It looks

[jira] [Commented] (YARN-2681) Support bandwidth enforcement for containers while reading from HDFS

2014-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180089#comment-14180089 ] Hadoop QA commented on YARN-2681: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2701) Potential race condition in startLocalizer when using LinuxContainerExecutor

2014-10-22 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180119#comment-14180119 ] zhihai xu commented on YARN-2701: - One nit in the addendum patch: Can we change {code} if

[jira] [Commented] (YARN-2010) RM can't transition to active if it can't recover an app attempt

2014-10-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180130#comment-14180130 ] Jason Lowe commented on YARN-2010: -- We recently ran into a case where an application tried

[jira] [Commented] (YARN-2681) Support bandwidth enforcement for containers while reading from HDFS

2014-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180134#comment-14180134 ] Hadoop QA commented on YARN-2681: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2010) RM can't transition to active if it can't recover an app attempt

2014-10-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180142#comment-14180142 ] Karthik Kambatla commented on YARN-2010: I should have an updated patch with tests

[jira] [Commented] (YARN-2578) NM does not failover timely if RM node network connection fails

2014-10-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180144#comment-14180144 ] Ming Ma commented on YARN-2578: --- Yeah, it is more than just * -> RM, it could be * -> NM and

[jira] [Updated] (YARN-2701) Potential race condition in startLocalizer when using LinuxContainerExecutor

2014-10-22 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2701: Attachment: YARN-2701.addendum.2.patch > Potential race condition in startLocalizer when using LinuxContainer

[jira] [Commented] (YARN-2701) Potential race condition in startLocalizer when using LinuxContainerExecutor

2014-10-22 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180174#comment-14180174 ] Xuan Gong commented on YARN-2701: - [~zxu] Thanks for reviewing this patch again. New patch

[jira] [Commented] (YARN-2723) rmadmin -replaceLabelsOnNode does not correctly parse port

2014-10-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180206#comment-14180206 ] Wangda Tan commented on YARN-2723: -- [~Naganarasimha], is there any updates on this patch?

[jira] [Commented] (YARN-2723) rmadmin -replaceLabelsOnNode does not correctly parse port

2014-10-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180244#comment-14180244 ] Naganarasimha G R commented on YARN-2723: - Its almost done i will attach the patch

[jira] [Commented] (YARN-2723) rmadmin -replaceLabelsOnNode does not correctly parse port

2014-10-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180248#comment-14180248 ] Wangda Tan commented on YARN-2723: -- Thanks :) > rmadmin -replaceLabelsOnNode does not cor

[jira] [Commented] (YARN-2647) Add yarn queue CLI to get queue info including labels of such queue

2014-10-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180304#comment-14180304 ] Wangda Tan commented on YARN-2647: -- [~sunilg], Thanks for working on this item, bq. Namely

[jira] [Updated] (YARN-2723) rmadmin -replaceLabelsOnNode does not correctly parse port

2014-10-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2723: Attachment: YARN-2723.20141023.1.patch attaching patch for this issue > rmadmin -replaceLabe

[jira] [Created] (YARN-2727) In RMAdminCLI usage display, instead of "yarn.node-labels.fs-store.root-dir", "yarn.node-labels.fs-store.uri" is being displayed

2014-10-22 Thread Naganarasimha G R (JIRA)
Naganarasimha G R created YARN-2727: --- Summary: In RMAdminCLI usage display, instead of "yarn.node-labels.fs-store.root-dir", "yarn.node-labels.fs-store.uri" is being displayed Key: YARN-2727 URL: https://issues

[jira] [Updated] (YARN-2727) In RMAdminCLI usage display, instead of "yarn.node-labels.fs-store.root-dir", "yarn.node-labels.fs-store.uri" is being displayed

2014-10-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2727: Attachment: YARN-2727.20141023.1.patch attaching patch > In RMAdminCLI usage display, instea

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

2014-10-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180437#comment-14180437 ] Jian He commented on YARN-2198: --- Not sure if the test failure is related. re-triger jenkins

[jira] [Commented] (YARN-2727) In RMAdminCLI usage display, instead of "yarn.node-labels.fs-store.root-dir", "yarn.node-labels.fs-store.uri" is being displayed

2014-10-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180456#comment-14180456 ] Wangda Tan commented on YARN-2727: -- [~Naganarasimha], Thanks for the patch, some comments:

[jira] [Created] (YARN-2728) Support for disabling the Centralized NodeLabel validation in Distributed Node Label Configuration setup

2014-10-22 Thread Naganarasimha G R (JIRA)
Naganarasimha G R created YARN-2728: --- Summary: Support for disabling the Centralized NodeLabel validation in Distributed Node Label Configuration setup Key: YARN-2728 URL: https://issues.apache.org/jira/browse/Y

[jira] [Commented] (YARN-2723) rmadmin -replaceLabelsOnNode does not correctly parse port

2014-10-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180458#comment-14180458 ] Wangda Tan commented on YARN-2723: -- [~Naganarasimha] Thanks for the patch, some comments:

[jira] [Commented] (YARN-2727) In RMAdminCLI usage display, instead of "yarn.node-labels.fs-store.root-dir", "yarn.node-labels.fs-store.uri" is being displayed

2014-10-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180457#comment-14180457 ] Wangda Tan commented on YARN-2727: -- Oh sorry, this comment is for YARN-2723, please ignore

[jira] [Created] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2014-10-22 Thread Naganarasimha G R (JIRA)
Naganarasimha G R created YARN-2729: --- Summary: Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup Key: YARN-2729 URL: https://issues.apache.org/jira/browse/YARN-2729

[jira] [Commented] (YARN-2700) TestSecureRMRegistryOperations failing on windows: auth problems

2014-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180468#comment-14180468 ] Hudson commented on YARN-2700: -- FAILURE: Integrated in Hadoop-trunk-Commit #6313 (See [https:

[jira] [Updated] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2014-10-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2729: Attachment: YARN-2729.20141023-1.patch Attaching the WIP patch for this part of the issue...

[jira] [Commented] (YARN-2723) rmadmin -replaceLabelsOnNode does not correctly parse port

2014-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180484#comment-14180484 ] Hadoop QA commented on YARN-2723: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

2014-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180493#comment-14180493 ] Hadoop QA commented on YARN-2198: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2727) In RMAdminCLI usage display, instead of "yarn.node-labels.fs-store.root-dir", "yarn.node-labels.fs-store.uri" is being displayed

2014-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180494#comment-14180494 ] Hadoop QA commented on YARN-2727: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2495) Allow admin specify labels in each NM (Distributed configuration)

2014-10-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2495: Attachment: YARN-2495.20141023-1.patch As per Wangda's comments 1> raised new jira for "disa

[jira] [Updated] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

2014-10-22 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2724: -- Target Version/s: (was: 2.5.1) bq. As the log aggregation is done by NM user, g

[jira] [Updated] (YARN-2503) Changes in RM Web UI to better show labels to end users

2014-10-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2503: - Description: Include but not limited to: - Show labels of nodes in RM/nodes page - Show labels of queue in

[jira] [Updated] (YARN-2503) Changes in RM Web UI to better show labels to end users

2014-10-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2503: - Attachment: YARN-2503-20141022-1.patch Attached an updated patch > Changes in RM Web UI to better s

[jira] [Commented] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

2014-10-22 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180554#comment-14180554 ] Xuan Gong commented on YARN-2724: - As [~mitdesai] mentioned, "the problem here is due to ca

[jira] [Commented] (YARN-2314) ContainerManagementProtocolProxy can create thousands of threads for a large cluster

2014-10-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180575#comment-14180575 ] Jian He commented on YARN-2314: --- Thanks Jason, I looked at the patch, looks good overall. jus

[jira] [Commented] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

2014-10-22 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180581#comment-14180581 ] Xuan Gong commented on YARN-2724: - So, for the exception reported here is because of the fi

[jira] [Commented] (YARN-2701) Potential race condition in startLocalizer when using LinuxContainerExecutor

2014-10-22 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180592#comment-14180592 ] Xuan Gong commented on YARN-2701: - [~aw] Do you have any other comments for this patch ? >

[jira] [Commented] (YARN-2726) CapacityScheduler should explicitly log when an accessible label has no capacity

2014-10-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180594#comment-14180594 ] Wangda Tan commented on YARN-2726: -- [~tweek], good suggestion! I completely agree to make

[jira] [Updated] (YARN-2726) CapacityScheduler should explicitly log when an accessible label has no capacity

2014-10-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2726: - Issue Type: Sub-task (was: Improvement) Parent: YARN-2492 > CapacityScheduler should explicitly lo

[jira] [Commented] (YARN-2726) CapacityScheduler should explicitly log when an accessible label has no capacity

2014-10-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180637#comment-14180637 ] Wangda Tan commented on YARN-2726: -- Converted this to sub task of YARN-2492 > CapacitySch

[jira] [Updated] (YARN-2721) Race condition: ZKRMStateStore retry logic may throw NodeExist exception

2014-10-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2721: --- Priority: Blocker (was: Major) > Race condition: ZKRMStateStore retry logic may throw NodeExis

[jira] [Updated] (YARN-2722) Disable SSLv3 (POODLEbleed vulnerability) in YARN shuffle

2014-10-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2722: -- Attachment: YARN-2722-1.patch This patch creates a whilelist {"TLSv1.2", "TLSv1.1", "TLSv1"} for the SSLFactory.

[jira] [Commented] (YARN-2183) Cleaner service for cache manager

2014-10-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180676#comment-14180676 ] Karthik Kambatla commented on YARN-2183: bq. we do have a YARN admin command implem

[jira] [Commented] (YARN-2503) Changes in RM Web UI to better show labels to end users

2014-10-22 Thread Hadoop QA (JIRA)
ults of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12676426/YARN-2503-20141022-1.patch against trunk revision 7b0f9bb. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The p

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

2014-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180690#comment-14180690 ] Hadoop QA commented on YARN-2198: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

2014-10-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180695#comment-14180695 ] Jian He commented on YARN-2198: --- committing > Remove the need to run NodeManager as privile

[jira] [Commented] (YARN-2722) Disable SSLv3 (POODLEbleed vulnerability) in YARN shuffle

2014-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180724#comment-14180724 ] Hadoop QA commented on YARN-2722: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2718) Create a CompositeConatainerExecutor that combines DockerContainerExecutor and DefaultContainerExecutor

2014-10-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180728#comment-14180728 ] Allen Wittenauer commented on YARN-2718: I don't think creating some sort of mutant

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

2014-10-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180733#comment-14180733 ] Jian He commented on YARN-2198: --- thanks Craig for reviewing the patch ! > Remove the need to

[jira] [Commented] (YARN-1063) Winutils needs ability to create task as domain user

2014-10-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180735#comment-14180735 ] Jian He commented on YARN-1063: --- I merged this to 2.6, as this was marked for 2.6 > Winutils

[jira] [Updated] (YARN-2010) RM can't transition to active if it can't recover an app attempt

2014-10-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2010: --- Attachment: yarn-2010-4.patch > RM can't transition to active if it can't recover an app attemp

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

2014-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180739#comment-14180739 ] Hudson commented on YARN-2198: -- FAILURE: Integrated in Hadoop-trunk-Commit #6318 (See [https:

[jira] [Updated] (YARN-2010) If RM fails to recover an app, it can never transition to active again

2014-10-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2010: --- Summary: If RM fails to recover an app, it can never transition to active again (was: RM can't

[jira] [Updated] (YARN-2730) Only one localizer can run on a NodeManager at a time

2014-10-22 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2730: -- Description: The synchronized modifier appears to have been added by https://issues.apache.org/jira/browse/MAPRE

[jira] [Created] (YARN-2730) Only one localizer can run on a NodeManager at a time

2014-10-22 Thread Siqi Li (JIRA)
Siqi Li created YARN-2730: - Summary: Only one localizer can run on a NodeManager at a time Key: YARN-2730 URL: https://issues.apache.org/jira/browse/YARN-2730 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-2010) If RM fails to recover an app, it can never transition to active again

2014-10-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180747#comment-14180747 ] Karthik Kambatla commented on YARN-2010: This JIRA has been an open for a while and

[jira] [Updated] (YARN-2730) Only one localizer can run on a NodeManager at a time

2014-10-22 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2730: -- Description: We are seeing that when one of the localizerRunner stuck, the rest of the localizerRunners are bloc

[jira] [Assigned] (YARN-2730) Only one localizer can run on a NodeManager at a time

2014-10-22 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li reassigned YARN-2730: - Assignee: Siqi Li > Only one localizer can run on a NodeManager at a time > --

[jira] [Updated] (YARN-2730) Only one localizer can run on a NodeManager at a time

2014-10-22 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2730: -- Affects Version/s: (was: 2.5.0) 2.4.0 > Only one localizer can run on a NodeManager at

[jira] [Updated] (YARN-2010) If RM fails to recover an app, it can never transition to active again

2014-10-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2010: --- Attachment: issue-stack-strace.rtf > If RM fails to recover an app, it can never transition to

  1   2   >