[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux
[ https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923545#comment-13923545 ] Tsuyoshi OZAWA commented on YARN-1798: -- Here is {code} Failed tests: TestContainerLaunch.testDelayedKill:723 ->internalKillTest:679 ->BaseContainerManagerTest.waitForContainerState:254 ->BaseContainerManagerTest.waitForContainerState:276 ContainerState is not correct (timedout) expected: but was: TestContainerLaunch.testImmediateKill:728->internalKillTest:679->BaseContainerManagerTest.waitForContainerState:254 ->BaseContainerManagerTest.waitForContainerState:276 ContainerState is not correct (timedout) expected: but was: TestContainerLaunch.testContainerEnvVariables:557 Process is not alive! TestContainerManager.testContainerLaunchAndStop:333 Process is not alive! TestContainersMonitor.testContainerKillOnMemoryOverflow:273 expected:<143> but was:<0> TestNodeManagerShutdown.testKillContainersOnShutdown:153 Did not find sigterm message TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown:1186 Containers not cleaned up when NM stopped Tests in error: TestNodeManagerResync.testKillContainersOnResync:91 ? Metrics Metrics source J... Tests run: 203, Failures: 7, Errors: 1, Skipped: 1 {code} > TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, > TestNodeStatusUpdater fails on Linux > - > > Key: YARN-1798 > URL: https://issues.apache.org/jira/browse/YARN-1798 > Project: Hadoop YARN > Issue Type: Bug >Reporter: Tsuyoshi OZAWA > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux
[ https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923546#comment-13923546 ] Tsuyoshi OZAWA commented on YARN-1798: -- Here is a result of test execution locally. > TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, > TestNodeStatusUpdater fails on Linux > - > > Key: YARN-1798 > URL: https://issues.apache.org/jira/browse/YARN-1798 > Project: Hadoop YARN > Issue Type: Bug >Reporter: Tsuyoshi OZAWA > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux
[ https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13932013#comment-13932013 ] Tsuyoshi OZAWA commented on YARN-1798: -- Additional log about TestNodeManagerShutdown.testKillContainersOnShutdown failure: {code} Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 6.783 sec <<< FAILURE! - in org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown testKillContainersOnShutdown(org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown) Time elapsed: 6.456 sec <<< FAILURE! junit.framework.AssertionFailedError: Did not find sigterm message at junit.framework.Assert.fail(Assert.java:50) at junit.framework.Assert.assertTrue(Assert.java:20) at org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown.testKillContainersOnShutdown(TestNodeManagerShutdown.java:153) {code} > TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, > TestNodeStatusUpdater fails on Linux > - > > Key: YARN-1798 > URL: https://issues.apache.org/jira/browse/YARN-1798 > Project: Hadoop YARN > Issue Type: Bug >Reporter: Tsuyoshi OZAWA > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux
[ https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13973412#comment-13973412 ] Wangda Tan commented on YARN-1798: -- I just tried, but cannot reproduce it. Is there anyone else can try to reproduce it too? > TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, > TestNodeStatusUpdater fails on Linux > - > > Key: YARN-1798 > URL: https://issues.apache.org/jira/browse/YARN-1798 > Project: Hadoop YARN > Issue Type: Test >Reporter: Tsuyoshi OZAWA > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux
[ https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13974194#comment-13974194 ] Tsuyoshi OZAWA commented on YARN-1798: -- I could reproduce the failure of TestContainerLaunch: {quote} Running org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch Tests run: 10, Failures: 3, Errors: 0, Skipped: 0, Time elapsed: 57.103 sec <<< FAILURE! - in org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch testDelayedKill(org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch) Time elapsed: 25.302 sec <<< FAILURE! java.lang.AssertionError: ContainerState is not correct (timedout) expected: but was: at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotEquals(Assert.java:647) at org.junit.Assert.assertEquals(Assert.java:128) at org.apache.hadoop.yarn.server.nodemanager.containermanager.BaseContainerManagerTest.waitForContainerState(BaseContainerManagerTest.java:276) at org.apache.hadoop.yarn.server.nodemanager.containermanager.BaseContainerManagerTest.waitForContainerState(BaseContainerManagerTest.java:254) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.internalKillTest(TestContainerLaunch.java:704) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.testDelayedKill(TestContainerLaunch.java:748) testImmediateKill(org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch) Time elapsed: 25.087 sec <<< FAILURE! java.lang.AssertionError: ContainerState is not correct (timedout) expected: but was: at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotEquals(Assert.java:647) at org.junit.Assert.assertEquals(Assert.java:128) at org.apache.hadoop.yarn.server.nodemanager.containermanager.BaseContainerManagerTest.waitForContainerState(BaseContainerManagerTest.java:276) at org.apache.hadoop.yarn.server.nodemanager.containermanager.BaseContainerManagerTest.waitForContainerState(BaseContainerManagerTest.java:254) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.internalKillTest(TestContainerLaunch.java:704) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.testImmediateKill(TestContainerLaunch.java:753) testContainerEnvVariables(org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch) Time elapsed: 5.058 sec <<< FAILURE! java.lang.AssertionError: Process is not alive! at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.assertTrue(Assert.java:43) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.testContainerEnvVariables(TestContainerLaunch.java:582) Running org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.TestContainersMonitor Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 19.69 sec <<< FAILURE! - in org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.TestContainersMonitor testContainerKillOnMemoryOverflow(org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.TestContainersMonitor) Time elapsed: 18.261 sec <<< FAILURE! java.lang.AssertionError: expected:<143> but was:<0> at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotEquals(Assert.java:647) at org.junit.Assert.assertEquals(Assert.java:128) at org.junit.Assert.assertEquals(Assert.java:472) at org.junit.Assert.assertEquals(Assert.java:456) at org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.TestContainersMonitor.testContainerKillOnMemoryOverflow(TestContainersMonitor.java:273) Running org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 6.731 sec <<< FAILURE! - in org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown testKillContainersOnShutdown(org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown) Time elapsed: 6.404 sec <<< FAILURE! java.lang.AssertionError: Did not find sigterm message at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.assertTrue(Assert.java:43) at org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown.testKillContainersOnShutdown(TestNodeManagerShutdown.java:153) {quote} > TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, > TestNodeStatusUpdater fails on Linux > - > > Key: YARN-1798 > URL: https://issues.apache.org/jira/br
[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux
[ https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13974197#comment-13974197 ] Tsuyoshi OZAWA commented on YARN-1798: -- output log is as follows: {quote} org.apache.hadoop.yarn.exceptions.YarnException: Unable to get local resources when Container container_1397835546010_0001_01_01 is at null at org.apache.hadoop.yarn.ipc.RPCUtil.getRemoteException(RPCUtil.java:45) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:173) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.testCallFailureWithNullLocalizedResources(TestContainerLaunch.java:779) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:263) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:68) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:47) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:60) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:229) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:50) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:222) at org.junit.runners.ParentRunner.run(ParentRunner.java:300) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) {quote} > TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, > TestNodeStatusUpdater fails on Linux > - > > Key: YARN-1798 > URL: https://issues.apache.org/jira/browse/YARN-1798 > Project: Hadoop YARN > Issue Type: Test >Reporter: Tsuyoshi OZAWA > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux
[ https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13974207#comment-13974207 ] Tsuyoshi OZAWA commented on YARN-1798: -- Sorry, the output log I mentioned in comment looks not related to test failure - it works well in test. The test failure looks just assertion failure because of timing issue. > TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, > TestNodeStatusUpdater fails on Linux > - > > Key: YARN-1798 > URL: https://issues.apache.org/jira/browse/YARN-1798 > Project: Hadoop YARN > Issue Type: Test >Reporter: Tsuyoshi OZAWA > Attachments: TestContainerLaunch-output.txt > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux
[ https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13974255#comment-13974255 ] Tsuyoshi OZAWA commented on YARN-1798: -- Confirmed attached patch is not enough. I'll look deeply. > TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, > TestNodeStatusUpdater fails on Linux > - > > Key: YARN-1798 > URL: https://issues.apache.org/jira/browse/YARN-1798 > Project: Hadoop YARN > Issue Type: Test >Reporter: Tsuyoshi OZAWA >Assignee: Tsuyoshi OZAWA > Attachments: TestContainerLaunch-output.txt, TestContainerLaunch.txt, > YARN-1798.1.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux
[ https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13974264#comment-13974264 ] Hadoop QA commented on YARN-1798: - {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12640845/YARN-1798.1.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 1 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/3596//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/3596//console This message is automatically generated. > TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, > TestNodeStatusUpdater fails on Linux > - > > Key: YARN-1798 > URL: https://issues.apache.org/jira/browse/YARN-1798 > Project: Hadoop YARN > Issue Type: Test >Reporter: Tsuyoshi OZAWA >Assignee: Tsuyoshi OZAWA > Attachments: TestContainerLaunch-output.txt, TestContainerLaunch.txt, > YARN-1798.1.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux
[ https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14269940#comment-14269940 ] Jian He commented on YARN-1798: --- I think the issue is outdated now, may be close? > TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, > TestNodeStatusUpdater fails on Linux > - > > Key: YARN-1798 > URL: https://issues.apache.org/jira/browse/YARN-1798 > Project: Hadoop YARN > Issue Type: Test >Reporter: Tsuyoshi OZAWA >Assignee: Tsuyoshi OZAWA > Attachments: TestContainerLaunch-output.txt, TestContainerLaunch.txt, > YARN-1798.1.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux
[ https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270004#comment-14270004 ] Hadoop QA commented on YARN-1798: - {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12640845/YARN-1798.1.patch against trunk revision cc2a745. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 1 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/6283//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/6283//console This message is automatically generated. > TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, > TestNodeStatusUpdater fails on Linux > - > > Key: YARN-1798 > URL: https://issues.apache.org/jira/browse/YARN-1798 > Project: Hadoop YARN > Issue Type: Test >Reporter: Tsuyoshi OZAWA >Assignee: Tsuyoshi OZAWA > Attachments: TestContainerLaunch-output.txt, TestContainerLaunch.txt, > YARN-1798.1.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)