[jira] [Assigned] (YARN-506) Move to common utils FileUtil#setReadable/Writable/Executable and FileUtil#canRead/Write/Execute

2013-03-27 Thread Ivan Mitic (JIRA)
[ https://issues.apache.org/jira/browse/YARN-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Mitic reassigned YARN-506: --- Assignee: Ivan Mitic > Move to common utils FileUtil#setReadable/Writable/Executable and > FileUti

[jira] [Updated] (YARN-309) Make RM provide heartbeat interval to NM

2013-03-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-309: --- Attachment: YARN-309.6.patch > Make RM provide heartbeat interval to NM > -

[jira] [Commented] (YARN-101) If the heartbeat message loss, the nodestatus info of complete container will loss too.

2013-03-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13616016#comment-13616016 ] Xuan Gong commented on YARN-101: create the patch based on the latest comments

[jira] [Updated] (YARN-101) If the heartbeat message loss, the nodestatus info of complete container will loss too.

2013-03-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-101: --- Attachment: YARN-101.3.patch > If the heartbeat message loss, the nodestatus info of complete container >

[jira] [Commented] (YARN-509) ResourceTrackerPB misses KerberosInfo annotation which renders YARN unusable on secure clusters

2013-03-27 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/YARN-509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615934#comment-13615934 ] Konstantin Boudnik commented on YARN-509: - I think it works around the problem rathe

[jira] [Updated] (YARN-509) ResourceTrackerPB misses KerberosInfo annotation which renders YARN unusable on secure clusters

2013-03-27 Thread Roman Shaposhnik (JIRA)
[ https://issues.apache.org/jira/browse/YARN-509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Shaposhnik updated YARN-509: -- Attachment: YARN-509.patch.txt > ResourceTrackerPB misses KerberosInfo annotation which rende

[jira] [Updated] (YARN-509) ResourceTrackerPB misses KerberosInfo annotation which renders YARN unusable on secure clusters

2013-03-27 Thread Roman Shaposhnik (JIRA)
[ https://issues.apache.org/jira/browse/YARN-509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Shaposhnik updated YARN-509: -- Attachment: (was: YARN-509.patch.txt) > ResourceTrackerPB misses KerberosInfo annotation

[jira] [Updated] (YARN-509) ResourceTrackerPB misses KerberosInfo annotation which renders YARN unusable on secure clusters

2013-03-27 Thread Roman Shaposhnik (JIRA)
[ https://issues.apache.org/jira/browse/YARN-509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Shaposhnik updated YARN-509: -- Attachment: YARN-509.patch.txt So it appears that $substitution in hadoop-policy.xml is broken.

[jira] [Commented] (YARN-467) Jobs fail during resource localization when public distributed-cache hits unix directory limits

2013-03-27 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615908#comment-13615908 ] Omkar Vinit Joshi commented on YARN-467: Adding tests to validate the expected behav

[jira] [Updated] (YARN-493) NodeManager job control logic flaws on Windows

2013-03-27 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated YARN-493: --- Attachment: YARN-493.2.patch {quote} would make sense to expose common Shell/Test utilities that would

[jira] [Commented] (YARN-467) Jobs fail during resource localization when public distributed-cache hits unix directory limits

2013-03-27 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615894#comment-13615894 ] Omkar Vinit Joshi commented on YARN-467: The Underlying problem here is that Resourc

[jira] [Commented] (YARN-24) Nodemanager fails to start if log aggregation enabled and namenode unavailable

2013-03-27 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-24?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615878#comment-13615878 ] Alejandro Abdelnur commented on YARN-24: +1 > Nodemanager fails to s

[jira] [Updated] (YARN-99) Jobs fail during resource localization when private distributed-cache hits unix directory limits

2013-03-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-99?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-99: Summary: Jobs fail during resource localization when private distributed-cache hits un

[jira] [Updated] (YARN-467) Jobs fail during resource localization when public distributed-cache hits unix directory limits

2013-03-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-467: - Summary: Jobs fail during resource localization when public distributed-cache hits

[jira] [Created] (YARN-511) ConverterUtils's getPathFromYarnURL and getYarnUrlFromPath work with fully qualified paths alone but don't state or check that

2013-03-27 Thread Harsh J (JIRA)
Harsh J created YARN-511: Summary: ConverterUtils's getPathFromYarnURL and getYarnUrlFromPath work with fully qualified paths alone but don't state or check that Key: YARN-511 URL: https://issues.apache.org/jira/browse/Y

[jira] [Updated] (YARN-309) Make RM provide heartbeat interval to NM

2013-03-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-309: --- Attachment: YARN-309.5.patch 1. Remove setter 2. Remove the extra heartbeatInterval value checking at nodeHeart

[jira] [Updated] (YARN-425) coverage fix for yarn api

2013-03-27 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated YARN-425: --- Assignee: Aleksey Gorshkov > coverage fix for yarn api > - > >

[jira] [Updated] (YARN-480) fix coverage org.apache.hadoop.yarn.server.resourcemanager.api.*

2013-03-27 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated YARN-480: --- Assignee: Aleksey Gorshkov > fix coverage org.apache.hadoop.yarn.server.resourcemanager.api.* > --

[jira] [Updated] (YARN-209) Capacity scheduler doesn't trigger app-activation after adding nodes

2013-03-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-209: - Component/s: capacityscheduler > Capacity scheduler doesn't trigger app-activat

[jira] [Commented] (YARN-209) Capacity scheduler doesn't trigger app-activation after adding nodes

2013-03-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615610#comment-13615610 ] Vinod Kumar Vavilapalli commented on YARN-209: -- bq. So, on a single-node cluste

[jira] [Commented] (YARN-309) Make RM provide heartbeat interval to NM

2013-03-27 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615605#comment-13615605 ] Bikas Saha commented on YARN-309: - why is this check needed when it has already been done du

[jira] [Commented] (YARN-209) Capacity scheduler doesn't trigger app-activation after adding nodes

2013-03-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615603#comment-13615603 ] Zhijie Shen commented on YARN-209: -- @Vinod, I tested the patch with the following logic: 1

[jira] [Commented] (YARN-209) Capacity scheduler doesn't trigger app-activation after adding nodes

2013-03-27 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615589#comment-13615589 ] Bikas Saha commented on YARN-209: - The new version of the test makes more sense. Looks good.

[jira] [Commented] (YARN-209) Capacity scheduler doesn't trigger app-activation after adding nodes

2013-03-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615551#comment-13615551 ] Vinod Kumar Vavilapalli commented on YARN-209: -- bq. So, in other words, if an a

[jira] [Commented] (YARN-209) Capacity scheduler doesn't trigger app-activation after adding nodes

2013-03-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615545#comment-13615545 ] Vinod Kumar Vavilapalli commented on YARN-209: -- Patch looks good, can you test

[jira] [Resolved] (YARN-474) CapacityScheduler does not activate applications when maximum-am-resource-percent configuration is refreshed

2013-03-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-474. -- Resolution: Fixed Build passed, closing this. Thanks for the help, [~cos] and [~t

[jira] [Commented] (YARN-474) CapacityScheduler does not activate applications when maximum-am-resource-percent configuration is refreshed

2013-03-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615520#comment-13615520 ] Vinod Kumar Vavilapalli commented on YARN-474: -- Merged HADOOP-8415 and this one

[jira] [Commented] (YARN-474) CapacityScheduler does not activate applications when maximum-am-resource-percent configuration is refreshed

2013-03-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615465#comment-13615465 ] Vinod Kumar Vavilapalli commented on YARN-474: -- I looked at HADOOP-8415 which a

[jira] [Commented] (YARN-474) CapacityScheduler does not activate applications when maximum-am-resource-percent configuration is refreshed

2013-03-27 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615348#comment-13615348 ] Thomas Graves commented on YARN-474: I reverted the branch-2 change for now.

[jira] [Commented] (YARN-496) Fair scheduler configs are refreshed inconsistently in reinitialize

2013-03-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615345#comment-13615345 ] Hudson commented on YARN-496: - Integrated in Hadoop-trunk-Commit #3535 (See [https://builds.apa

[jira] [Commented] (YARN-474) CapacityScheduler does not activate applications when maximum-am-resource-percent configuration is refreshed

2013-03-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615279#comment-13615279 ] Hudson commented on YARN-474: - Integrated in Hadoop-Mapreduce-trunk #1385 (See [https://builds.

[jira] [Commented] (YARN-440) Flatten RegisterNodeManagerResponse

2013-03-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615273#comment-13615273 ] Hudson commented on YARN-440: - Integrated in Hadoop-Mapreduce-trunk #1385 (See [https://builds.

[jira] [Commented] (YARN-157) The option shell_command and shell_script have conflict

2013-03-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615271#comment-13615271 ] Hadoop QA commented on YARN-157: {color:red}-1 overall{color}. Here are the results of test

[jira] [Updated] (YARN-157) The option shell_command and shell_script have conflict

2013-03-27 Thread rainy Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rainy Yu updated YARN-157: -- Attachment: hadoop_yarn.patch This patch can let option shell_command not be mandatory when running distributedS

[jira] [Commented] (YARN-474) CapacityScheduler does not activate applications when maximum-am-resource-percent configuration is refreshed

2013-03-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615208#comment-13615208 ] Hudson commented on YARN-474: - Integrated in Hadoop-Hdfs-trunk #1357 (See [https://builds.apach

[jira] [Commented] (YARN-440) Flatten RegisterNodeManagerResponse

2013-03-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615203#comment-13615203 ] Hudson commented on YARN-440: - Integrated in Hadoop-Hdfs-trunk #1357 (See [https://builds.apach

[jira] [Commented] (YARN-474) CapacityScheduler does not activate applications when maximum-am-resource-percent configuration is refreshed

2013-03-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615108#comment-13615108 ] Hudson commented on YARN-474: - Integrated in Hadoop-Yarn-trunk #168 (See [https://builds.apache

[jira] [Commented] (YARN-440) Flatten RegisterNodeManagerResponse

2013-03-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615103#comment-13615103 ] Hudson commented on YARN-440: - Integrated in Hadoop-Yarn-trunk #168 (See [https://builds.apache

[jira] [Commented] (YARN-474) CapacityScheduler does not activate applications when maximum-am-resource-percent configuration is refreshed

2013-03-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615052#comment-13615052 ] Hadoop QA commented on YARN-474: {color:red}-1 overall{color}. Here are the results of test

[jira] [Updated] (YARN-474) CapacityScheduler does not activate applications when maximum-am-resource-percent configuration is refreshed

2013-03-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-474: - Attachment: YARN-474.4.patch Branch-2 failed because Configuration of it unexpectedly doesn't have setDoub

[jira] [Reopened] (YARN-474) CapacityScheduler does not activate applications when maximum-am-resource-percent configuration is refreshed

2013-03-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reopened YARN-474: -- Branch-2 was failed by the patch. > CapacityScheduler does not activate applications when >

[jira] [Commented] (YARN-493) NodeManager job control logic flaws on Windows

2013-03-27 Thread Ivan Mitic (JIRA)
[ https://issues.apache.org/jira/browse/YARN-493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13614989#comment-13614989 ] Ivan Mitic commented on YARN-493: - Hi Chris, patch looks good Just one question, would make