[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers

2011-09-12 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13102464#comment-13102464
 ] 

Hadoop QA commented on MAPREDUCE-2749:
--

+1 overall.  Here are the results of testing the latest attachment 
  
http://issues.apache.org/jira/secure/attachment/12493990/MAPREDUCE-2749-20110912.1.txt
  against trunk revision .

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 21 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed unit tests in .

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/698//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/698//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-hs.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/698//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-shuffle.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/698//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/698//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-app.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/698//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-jobclient.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/698//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-core.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/698//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/698//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/698//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/698//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/698//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-api.html
Console output: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/698//console

This message is automatically generated.

 [MR-279] NM registers with RM even before it starts various servers
 ---

 Key: MAPREDUCE-2749
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Thomas Graves
 Fix For: 0.23.0

 Attachments: MAPREDUCE-2749-20110912.1.txt, 
 MAPREDUCE-2749-20110912.txt, MAPREDUCE-2749-v2.patch, 
 MAPREDUCE-2749-v3.patch, MAPREDUCE-2749-v4.patch, MAPREDUCE-2749.patch


 In case NM eventually fails to start the ContainerManager server because of 
 say a port clash, RM will have to wait for expiry to detect the NM crash.
 It is desirable to make NM register with RM only after it can start all of 
 its components successfully.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers

2011-09-12 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13102480#comment-13102480
 ] 

Hudson commented on MAPREDUCE-2749:
---

Integrated in Hadoop-Mapreduce-trunk-Commit #881 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/881/])
MAPREDUCE-2749. Ensure NM registers with RM after starting all its services 
correctly. Contributed by Thomas Graves.

acmurthy : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1169621
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/ContainerManagerImpl.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/DummyContainerManager.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestEventFlow.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeStatusUpdater.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/BaseContainerManagerTest.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/TestContainerManager.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/MiniYARNCluster.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/TestContainerTokenSecretManager.java


 [MR-279] NM registers with RM even before it starts various servers
 ---

 Key: MAPREDUCE-2749
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Thomas Graves
 Fix For: 0.23.0

 Attachments: MAPREDUCE-2749-20110912.1.txt, 
 MAPREDUCE-2749-20110912.txt, MAPREDUCE-2749-v2.patch, 
 MAPREDUCE-2749-v3.patch, MAPREDUCE-2749-v4.patch, MAPREDUCE-2749.patch


 In case NM eventually fails to start the ContainerManager server because of 
 say a port clash, RM will have to wait for expiry to detect the NM crash.
 It is desirable to make NM register with RM only after it can start all of 
 its components successfully.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers

2011-09-12 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13102479#comment-13102479
 ] 

Hudson commented on MAPREDUCE-2749:
---

Integrated in Hadoop-Common-trunk-Commit #869 (See 
[https://builds.apache.org/job/Hadoop-Common-trunk-Commit/869/])
MAPREDUCE-2749. Ensure NM registers with RM after starting all its services 
correctly. Contributed by Thomas Graves.

acmurthy : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1169621
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/ContainerManagerImpl.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/DummyContainerManager.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestEventFlow.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeStatusUpdater.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/BaseContainerManagerTest.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/TestContainerManager.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/MiniYARNCluster.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/TestContainerTokenSecretManager.java


 [MR-279] NM registers with RM even before it starts various servers
 ---

 Key: MAPREDUCE-2749
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Thomas Graves
 Fix For: 0.23.0

 Attachments: MAPREDUCE-2749-20110912.1.txt, 
 MAPREDUCE-2749-20110912.txt, MAPREDUCE-2749-v2.patch, 
 MAPREDUCE-2749-v3.patch, MAPREDUCE-2749-v4.patch, MAPREDUCE-2749.patch


 In case NM eventually fails to start the ContainerManager server because of 
 say a port clash, RM will have to wait for expiry to detect the NM crash.
 It is desirable to make NM register with RM only after it can start all of 
 its components successfully.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers

2011-09-12 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13102483#comment-13102483
 ] 

Hudson commented on MAPREDUCE-2749:
---

Integrated in Hadoop-Hdfs-trunk-Commit #946 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/946/])
MAPREDUCE-2749. Ensure NM registers with RM after starting all its services 
correctly. Contributed by Thomas Graves.

acmurthy : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1169621
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/ContainerManagerImpl.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/DummyContainerManager.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestEventFlow.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeStatusUpdater.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/BaseContainerManagerTest.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/TestContainerManager.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/MiniYARNCluster.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/TestContainerTokenSecretManager.java


 [MR-279] NM registers with RM even before it starts various servers
 ---

 Key: MAPREDUCE-2749
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Thomas Graves
 Fix For: 0.23.0

 Attachments: MAPREDUCE-2749-20110912.1.txt, 
 MAPREDUCE-2749-20110912.txt, MAPREDUCE-2749-v2.patch, 
 MAPREDUCE-2749-v3.patch, MAPREDUCE-2749-v4.patch, MAPREDUCE-2749.patch


 In case NM eventually fails to start the ContainerManager server because of 
 say a port clash, RM will have to wait for expiry to detect the NM crash.
 It is desirable to make NM register with RM only after it can start all of 
 its components successfully.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers

2011-09-12 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13102595#comment-13102595
 ] 

Hudson commented on MAPREDUCE-2749:
---

Integrated in Hadoop-Hdfs-trunk #791 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/791/])
MAPREDUCE-2749. Ensure NM registers with RM after starting all its services 
correctly. Contributed by Thomas Graves.

acmurthy : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1169621
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/ContainerManagerImpl.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/DummyContainerManager.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestEventFlow.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeStatusUpdater.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/BaseContainerManagerTest.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/TestContainerManager.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/MiniYARNCluster.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/TestContainerTokenSecretManager.java


 [MR-279] NM registers with RM even before it starts various servers
 ---

 Key: MAPREDUCE-2749
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Thomas Graves
 Fix For: 0.23.0

 Attachments: MAPREDUCE-2749-20110912.1.txt, 
 MAPREDUCE-2749-20110912.txt, MAPREDUCE-2749-v2.patch, 
 MAPREDUCE-2749-v3.patch, MAPREDUCE-2749-v4.patch, MAPREDUCE-2749.patch


 In case NM eventually fails to start the ContainerManager server because of 
 say a port clash, RM will have to wait for expiry to detect the NM crash.
 It is desirable to make NM register with RM only after it can start all of 
 its components successfully.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers

2011-09-12 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13102630#comment-13102630
 ] 

Hudson commented on MAPREDUCE-2749:
---

Integrated in Hadoop-Mapreduce-trunk #815 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/815/])
MAPREDUCE-2749. Ensure NM registers with RM after starting all its services 
correctly. Contributed by Thomas Graves.

acmurthy : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1169621
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/ContainerManagerImpl.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/DummyContainerManager.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestEventFlow.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeStatusUpdater.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/BaseContainerManagerTest.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/TestContainerManager.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/MiniYARNCluster.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/TestContainerTokenSecretManager.java


 [MR-279] NM registers with RM even before it starts various servers
 ---

 Key: MAPREDUCE-2749
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Thomas Graves
 Fix For: 0.23.0

 Attachments: MAPREDUCE-2749-20110912.1.txt, 
 MAPREDUCE-2749-20110912.txt, MAPREDUCE-2749-v2.patch, 
 MAPREDUCE-2749-v3.patch, MAPREDUCE-2749-v4.patch, MAPREDUCE-2749.patch


 In case NM eventually fails to start the ContainerManager server because of 
 say a port clash, RM will have to wait for expiry to detect the NM crash.
 It is desirable to make NM register with RM only after it can start all of 
 its components successfully.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers

2011-09-11 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13102439#comment-13102439
 ] 

Hadoop QA commented on MAPREDUCE-2749:
--

-1 overall.  Here are the results of testing the latest attachment 
  
http://issues.apache.org/jira/secure/attachment/12493988/MAPREDUCE-2749-20110912.txt
  against trunk revision .

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 21 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed these unit tests:
  
org.apache.hadoop.yarn.server.nodemanager.TestContainerManagerWithLCE
  
org.apache.hadoop.yarn.server.nodemanager.containermanager.container.TestContainer
  
org.apache.hadoop.yarn.server.nodemanager.containermanager.TestContainerManager
  
org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.TestContainersMonitor

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/697//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/697//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/697//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-api.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/697//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/697//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/697//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/697//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-app.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/697//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-core.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/697//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/697//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-hs.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/697//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-shuffle.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/697//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-jobclient.html
Console output: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/697//console

This message is automatically generated.

 [MR-279] NM registers with RM even before it starts various servers
 ---

 Key: MAPREDUCE-2749
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Thomas Graves
 Fix For: 0.23.0

 Attachments: MAPREDUCE-2749-20110912.txt, MAPREDUCE-2749-v2.patch, 
 MAPREDUCE-2749-v3.patch, MAPREDUCE-2749-v4.patch, MAPREDUCE-2749.patch


 In case NM eventually fails to start the ContainerManager server because of 
 say a port clash, RM will have to wait for expiry to detect the NM crash.
 It is desirable to make NM register with RM only after it can start all of 
 its components successfully.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers

2011-09-09 Thread Thomas Graves (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13101534#comment-13101534
 ] 

Thomas Graves commented on MAPREDUCE-2749:
--

Thanks for the review, I'll update the patch for the config changes.  I'll take 
another look at the test to see if I can get away from using minicluster.   The 
issue I have with this is that to me it is a system/component test and not a 
unit test - when nodemanager fails to start another component (RM) should do or 
in this case not do something.  When I was looking it really seemed like to 
really test it you want all the regular init/start code in the nm so mocking 
that didn't seem useful.  We could perhaps mock the rm register routine which 
is what the mini cluster already does for in process communication.

 [MR-279] NM registers with RM even before it starts various servers
 ---

 Key: MAPREDUCE-2749
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Thomas Graves
 Fix For: 0.23.0

 Attachments: MAPREDUCE-2749-v2.patch, MAPREDUCE-2749-v3.patch, 
 MAPREDUCE-2749-v4.patch, MAPREDUCE-2749.patch


 In case NM eventually fails to start the ContainerManager server because of 
 say a port clash, RM will have to wait for expiry to detect the NM crash.
 It is desirable to make NM register with RM only after it can start all of 
 its components successfully.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers

2011-09-08 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13100488#comment-13100488
 ] 

Hadoop QA commented on MAPREDUCE-2749:
--

-1 overall.  Here are the results of testing the latest attachment 
  
http://issues.apache.org/jira/secure/attachment/12493626/MAPREDUCE-2749-v3.patch
  against trunk revision .

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 21 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

-1 findbugs.  The patch appears to introduce 14 new Findbugs (version 
1.3.9) warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed these unit tests:

  org.apache.hadoop.yarn.server.nodemanager.TestNMAuditLogger

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/650//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/650//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-hs.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/650//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-shuffle.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/650//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/650//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-app.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/650//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-jobclient.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/650//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-core.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/650//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/650//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/650//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/650//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/650//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-api.html
Console output: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/650//console

This message is automatically generated.

 [MR-279] NM registers with RM even before it starts various servers
 ---

 Key: MAPREDUCE-2749
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Thomas Graves
 Fix For: 0.23.0

 Attachments: MAPREDUCE-2749-v2.patch, MAPREDUCE-2749-v3.patch, 
 MAPREDUCE-2749.patch


 In case NM eventually fails to start the ContainerManager server because of 
 say a port clash, RM will have to wait for expiry to detect the NM crash.
 It is desirable to make NM register with RM only after it can start all of 
 its components successfully.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers

2011-09-08 Thread Thomas Graves (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13100498#comment-13100498
 ] 

Thomas Graves commented on MAPREDUCE-2749:
--

looks like the issue is with TestContainerTokenSecretManager not correctly 
stopping the miniyarncluster its using.

 [MR-279] NM registers with RM even before it starts various servers
 ---

 Key: MAPREDUCE-2749
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Thomas Graves
 Fix For: 0.23.0

 Attachments: MAPREDUCE-2749-v2.patch, MAPREDUCE-2749-v3.patch, 
 MAPREDUCE-2749.patch


 In case NM eventually fails to start the ContainerManager server because of 
 say a port clash, RM will have to wait for expiry to detect the NM crash.
 It is desirable to make NM register with RM only after it can start all of 
 its components successfully.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers

2011-09-08 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13100832#comment-13100832
 ] 

Hadoop QA commented on MAPREDUCE-2749:
--

+1 overall.  Here are the results of testing the latest attachment 
  
http://issues.apache.org/jira/secure/attachment/12493701/MAPREDUCE-2749-v4.patch
  against trunk revision .

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 24 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed unit tests in .

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/668//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/668//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/668//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-hs.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/668//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-core.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/668//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-app.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/668//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-shuffle.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/668//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-jobclient.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/668//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-api.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/668//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/668//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/668//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/668//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-common.html
Console output: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/668//console

This message is automatically generated.

 [MR-279] NM registers with RM even before it starts various servers
 ---

 Key: MAPREDUCE-2749
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Thomas Graves
 Fix For: 0.23.0

 Attachments: MAPREDUCE-2749-v2.patch, MAPREDUCE-2749-v3.patch, 
 MAPREDUCE-2749-v4.patch, MAPREDUCE-2749.patch


 In case NM eventually fails to start the ContainerManager server because of 
 say a port clash, RM will have to wait for expiry to detect the NM crash.
 It is desirable to make NM register with RM only after it can start all of 
 its components successfully.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers

2011-09-06 Thread Thomas Graves (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13098166#comment-13098166
 ] 

Thomas Graves commented on MAPREDUCE-2749:
--

Hey Vinod, thanks for the feedback. what is we move the 
ContainerTokenSecretManager to the top level NodeManager composite and also 
pass it into the NodeStatusUpdater so it can update it as soon as it register 
with RM?  That way by the time the NodeStatusUpdater returns from its start() 
routine and can start sending heartbeats to rm everything is initialized and we 
won't have any race as to when the RM schedules containers for the rm.

 [MR-279] NM registers with RM even before it starts various servers
 ---

 Key: MAPREDUCE-2749
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Thomas Graves
 Fix For: 0.23.0

 Attachments: MAPREDUCE-2749-v2.patch, MAPREDUCE-2749.patch


 In case NM eventually fails to start the ContainerManager server because of 
 say a port clash, RM will have to wait for expiry to detect the NM crash.
 It is desirable to make NM register with RM only after it can start all of 
 its components successfully.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers

2011-09-06 Thread Vinod Kumar Vavilapalli (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13098577#comment-13098577
 ] 

Vinod Kumar Vavilapalli commented on MAPREDUCE-2749:


Perfect, that should work. +1 for your proposal. Thanks!

 [MR-279] NM registers with RM even before it starts various servers
 ---

 Key: MAPREDUCE-2749
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Thomas Graves
 Fix For: 0.23.0

 Attachments: MAPREDUCE-2749-v2.patch, MAPREDUCE-2749.patch


 In case NM eventually fails to start the ContainerManager server because of 
 say a port clash, RM will have to wait for expiry to detect the NM crash.
 It is desirable to make NM register with RM only after it can start all of 
 its components successfully.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers

2011-09-03 Thread Vinod Kumar Vavilapalli (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096628#comment-13096628
 ] 

Vinod Kumar Vavilapalli commented on MAPREDUCE-2749:


Thanks for the patch Thomas!

One minor comment I have with this patch is the setting of keys via the event. 
While this works, my concern is that if we do it this way, by the time 
{{NodeManager.start()}} returns, the server isn't still guaranteed to be ready 
for service. I think we can do this another way. If we move 
{{ContainerTokenSecretManager}} to the top level {{NodeManager}} composite, we 
can set the keys as the last step in {{NodeManager.start()}}. Thoughts?

Also, we can add a test for this - mock {{rpc.getServer()}} to throw an 
exception and verify that ResourceManager doesn't have any registered NM.

 [MR-279] NM registers with RM even before it starts various servers
 ---

 Key: MAPREDUCE-2749
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Thomas Graves
 Fix For: 0.23.0

 Attachments: MAPREDUCE-2749-v2.patch, MAPREDUCE-2749.patch


 In case NM eventually fails to start the ContainerManager server because of 
 say a port clash, RM will have to wait for expiry to detect the NM crash.
 It is desirable to make NM register with RM only after it can start all of 
 its components successfully.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers

2011-09-02 Thread Thomas Graves (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096016#comment-13096016
 ] 

Thomas Graves commented on MAPREDUCE-2749:
--

Steps to reproduce original issue:

on single node cluster:
- configure nm to be use same port as rm. (or another port that is already in 
use)
- start rm and nm
- view RM node webui (or logs) and see that the nm is registered
- After node timeout RM expires the node (default value is 60)

 [MR-279] NM registers with RM even before it starts various servers
 ---

 Key: MAPREDUCE-2749
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Thomas Graves
 Fix For: 0.23.0

 Attachments: MAPREDUCE-2749.patch


 In case NM eventually fails to start the ContainerManager server because of 
 say a port clash, RM will have to wait for expiry to detect the NM crash.
 It is desirable to make NM register with RM only after it can start all of 
 its components successfully.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers

2011-09-02 Thread Thomas Graves (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096068#comment-13096068
 ] 

Thomas Graves commented on MAPREDUCE-2749:
--

Manually tested with and without security. Verified jobs worked in both cases.

Test procedure for the error case is the same as steps to reproduce above, now 
however the NM will NOT show up on RM node webui if nm doesn't start properly.


 [MR-279] NM registers with RM even before it starts various servers
 ---

 Key: MAPREDUCE-2749
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Thomas Graves
 Fix For: 0.23.0

 Attachments: MAPREDUCE-2749-v2.patch, MAPREDUCE-2749.patch


 In case NM eventually fails to start the ContainerManager server because of 
 say a port clash, RM will have to wait for expiry to detect the NM crash.
 It is desirable to make NM register with RM only after it can start all of 
 its components successfully.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (MAPREDUCE-2749) [MR-279] NM registers with RM even before it starts various servers

2011-09-02 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096090#comment-13096090
 ] 

Hadoop QA commented on MAPREDUCE-2749:
--

-1 overall.  Here are the results of testing the latest attachment 
  
http://issues.apache.org/jira/secure/attachment/12492765/MAPREDUCE-2749-v2.patch
  against trunk revision .

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 3 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

-1 findbugs.  The patch appears to introduce 8 new Findbugs (version 1.3.9) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed unit tests in hadoop-mapreduce-project.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-hs.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-core.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-app.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-shuffle.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-jobclient.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-api.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-common.html
Console output: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/589//console

This message is automatically generated.

 [MR-279] NM registers with RM even before it starts various servers
 ---

 Key: MAPREDUCE-2749
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2749
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Thomas Graves
 Fix For: 0.23.0

 Attachments: MAPREDUCE-2749-v2.patch, MAPREDUCE-2749.patch


 In case NM eventually fails to start the ContainerManager server because of 
 say a port clash, RM will have to wait for expiry to detect the NM crash.
 It is desirable to make NM register with RM only after it can start all of 
 its components successfully.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira