[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux

2014-03-06 Thread Tsuyoshi OZAWA (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923545#comment-13923545
 ] 

Tsuyoshi OZAWA commented on YARN-1798:
--

Here is 


{code} 
Failed tests:   


  TestContainerLaunch.testDelayedKill:723
 ->internalKillTest:679
 ->BaseContainerManagerTest.waitForContainerState:254
 ->BaseContainerManagerTest.waitForContainerState:276 ContainerState is not 
correct (timedout) expected: but was:
  
TestContainerLaunch.testImmediateKill:728->internalKillTest:679->BaseContainerManagerTest.waitForContainerState:254
 ->BaseContainerManagerTest.waitForContainerState:276 ContainerState is not 
correct (timedout) expected: but was:
  TestContainerLaunch.testContainerEnvVariables:557 Process is not alive!
  TestContainerManager.testContainerLaunchAndStop:333 Process is not alive!
  TestContainersMonitor.testContainerKillOnMemoryOverflow:273 expected:<143> 
but was:<0> 
  TestNodeManagerShutdown.testKillContainersOnShutdown:153 Did not find sigterm 
message
  TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown:1186 Containers 
not cleaned up when NM stopped

Tests in error: 


  TestNodeManagerResync.testKillContainersOnResync:91 ? Metrics Metrics source 
J...
 



Tests run: 203, Failures: 7, Errors: 1, Skipped: 1  
{code}



> TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, 
> TestNodeStatusUpdater fails on Linux
> -
>
> Key: YARN-1798
> URL: https://issues.apache.org/jira/browse/YARN-1798
> Project: Hadoop YARN
>  Issue Type: Bug
>Reporter: Tsuyoshi OZAWA
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux

2014-03-06 Thread Tsuyoshi OZAWA (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923546#comment-13923546
 ] 

Tsuyoshi OZAWA commented on YARN-1798:
--

Here is a result of test execution locally. 

> TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, 
> TestNodeStatusUpdater fails on Linux
> -
>
> Key: YARN-1798
> URL: https://issues.apache.org/jira/browse/YARN-1798
> Project: Hadoop YARN
>  Issue Type: Bug
>Reporter: Tsuyoshi OZAWA
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux

2014-03-12 Thread Tsuyoshi OZAWA (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13932013#comment-13932013
 ] 

Tsuyoshi OZAWA commented on YARN-1798:
--

Additional log about TestNodeManagerShutdown.testKillContainersOnShutdown 
failure:

{code}
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 6.783 sec <<< 
FAILURE! - in org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown
testKillContainersOnShutdown(org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown)
  Time elapsed: 6.456 sec  <<< FAILURE!
junit.framework.AssertionFailedError: Did not find sigterm message
at junit.framework.Assert.fail(Assert.java:50)
at junit.framework.Assert.assertTrue(Assert.java:20)
at 
org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown.testKillContainersOnShutdown(TestNodeManagerShutdown.java:153)
{code}

> TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, 
> TestNodeStatusUpdater fails on Linux
> -
>
> Key: YARN-1798
> URL: https://issues.apache.org/jira/browse/YARN-1798
> Project: Hadoop YARN
>  Issue Type: Bug
>Reporter: Tsuyoshi OZAWA
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux

2014-04-17 Thread Wangda Tan (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13973412#comment-13973412
 ] 

Wangda Tan commented on YARN-1798:
--

I just tried, but cannot reproduce it. Is there anyone else can try to 
reproduce it too?

> TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, 
> TestNodeStatusUpdater fails on Linux
> -
>
> Key: YARN-1798
> URL: https://issues.apache.org/jira/browse/YARN-1798
> Project: Hadoop YARN
>  Issue Type: Test
>Reporter: Tsuyoshi OZAWA
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux

2014-04-18 Thread Tsuyoshi OZAWA (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13974194#comment-13974194
 ] 

Tsuyoshi OZAWA commented on YARN-1798:
--

I could reproduce the failure of TestContainerLaunch:
{quote}
Running 
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch
Tests run: 10, Failures: 3, Errors: 0, Skipped: 0, Time elapsed: 57.103 sec <<< 
FAILURE! - in 
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch
testDelayedKill(org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch)
  Time elapsed: 25.302 sec  <<< FAILURE!
java.lang.AssertionError: ContainerState is not correct (timedout) 
expected: but was:
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.BaseContainerManagerTest.waitForContainerState(BaseContainerManagerTest.java:276)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.BaseContainerManagerTest.waitForContainerState(BaseContainerManagerTest.java:254)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.internalKillTest(TestContainerLaunch.java:704)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.testDelayedKill(TestContainerLaunch.java:748)

testImmediateKill(org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch)
  Time elapsed: 25.087 sec  <<< FAILURE!
java.lang.AssertionError: ContainerState is not correct (timedout) 
expected: but was:
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.BaseContainerManagerTest.waitForContainerState(BaseContainerManagerTest.java:276)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.BaseContainerManagerTest.waitForContainerState(BaseContainerManagerTest.java:254)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.internalKillTest(TestContainerLaunch.java:704)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.testImmediateKill(TestContainerLaunch.java:753)

testContainerEnvVariables(org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch)
  Time elapsed: 5.058 sec  <<< FAILURE!
java.lang.AssertionError: Process is not alive!
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.testContainerEnvVariables(TestContainerLaunch.java:582)

Running 
org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.TestContainersMonitor
Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 19.69 sec <<< 
FAILURE! - in 
org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.TestContainersMonitor
testContainerKillOnMemoryOverflow(org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.TestContainersMonitor)
  Time elapsed: 18.261 sec  <<< FAILURE!
java.lang.AssertionError: expected:<143> but was:<0>
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.TestContainersMonitor.testContainerKillOnMemoryOverflow(TestContainersMonitor.java:273)

Running org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 6.731 sec <<< 
FAILURE! - in org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown
testKillContainersOnShutdown(org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown)
  Time elapsed: 6.404 sec  <<< FAILURE!
java.lang.AssertionError: Did not find sigterm message
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at 
org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown.testKillContainersOnShutdown(TestNodeManagerShutdown.java:153)
{quote}

> TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, 
> TestNodeStatusUpdater fails on Linux
> -
>
> Key: YARN-1798
> URL: https://issues.apache.org/jira/br

[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux

2014-04-18 Thread Tsuyoshi OZAWA (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13974197#comment-13974197
 ] 

Tsuyoshi OZAWA commented on YARN-1798:
--

output log is as follows:

{quote}
org.apache.hadoop.yarn.exceptions.YarnException: Unable to get local resources 
when Container container_1397835546010_0001_01_01 is at null
at 
org.apache.hadoop.yarn.ipc.RPCUtil.getRemoteException(RPCUtil.java:45)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:173)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.testCallFailureWithNullLocalizedResources(TestContainerLaunch.java:779)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:263)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:68)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:47)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:60)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:229)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:50)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:222)
at org.junit.runners.ParentRunner.run(ParentRunner.java:300)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
at 
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
at 
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
at 
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
{quote}

> TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, 
> TestNodeStatusUpdater fails on Linux
> -
>
> Key: YARN-1798
> URL: https://issues.apache.org/jira/browse/YARN-1798
> Project: Hadoop YARN
>  Issue Type: Test
>Reporter: Tsuyoshi OZAWA
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux

2014-04-18 Thread Tsuyoshi OZAWA (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13974207#comment-13974207
 ] 

Tsuyoshi OZAWA commented on YARN-1798:
--

Sorry, the output log I mentioned in comment looks not related to test failure 
- it works well in test. The test failure looks just assertion failure because 
of timing issue.

> TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, 
> TestNodeStatusUpdater fails on Linux
> -
>
> Key: YARN-1798
> URL: https://issues.apache.org/jira/browse/YARN-1798
> Project: Hadoop YARN
>  Issue Type: Test
>Reporter: Tsuyoshi OZAWA
> Attachments: TestContainerLaunch-output.txt
>
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux

2014-04-18 Thread Tsuyoshi OZAWA (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13974255#comment-13974255
 ] 

Tsuyoshi OZAWA commented on YARN-1798:
--

Confirmed attached patch is not enough. I'll look deeply.

> TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, 
> TestNodeStatusUpdater fails on Linux
> -
>
> Key: YARN-1798
> URL: https://issues.apache.org/jira/browse/YARN-1798
> Project: Hadoop YARN
>  Issue Type: Test
>Reporter: Tsuyoshi OZAWA
>Assignee: Tsuyoshi OZAWA
> Attachments: TestContainerLaunch-output.txt, TestContainerLaunch.txt, 
> YARN-1798.1.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux

2014-04-18 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13974264#comment-13974264
 ] 

Hadoop QA commented on YARN-1798:
-

{color:green}+1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12640845/YARN-1798.1.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 1 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  There were no new javadoc warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-YARN-Build/3596//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/3596//console

This message is automatically generated.

> TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, 
> TestNodeStatusUpdater fails on Linux
> -
>
> Key: YARN-1798
> URL: https://issues.apache.org/jira/browse/YARN-1798
> Project: Hadoop YARN
>  Issue Type: Test
>Reporter: Tsuyoshi OZAWA
>Assignee: Tsuyoshi OZAWA
> Attachments: TestContainerLaunch-output.txt, TestContainerLaunch.txt, 
> YARN-1798.1.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux

2015-01-08 Thread Jian He (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14269940#comment-14269940
 ] 

Jian He commented on YARN-1798:
---

I think the issue is outdated now, may be close?

> TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, 
> TestNodeStatusUpdater fails on Linux
> -
>
> Key: YARN-1798
> URL: https://issues.apache.org/jira/browse/YARN-1798
> Project: Hadoop YARN
>  Issue Type: Test
>Reporter: Tsuyoshi OZAWA
>Assignee: Tsuyoshi OZAWA
> Attachments: TestContainerLaunch-output.txt, TestContainerLaunch.txt, 
> YARN-1798.1.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-1798) TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, TestNodeStatusUpdater fails on Linux

2015-01-08 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270004#comment-14270004
 ] 

Hadoop QA commented on YARN-1798:
-

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12640845/YARN-1798.1.patch
  against trunk revision cc2a745.

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 1 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  There were no new javadoc warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 2.0.3) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager.

Test results: 
https://builds.apache.org/job/PreCommit-YARN-Build/6283//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/6283//console

This message is automatically generated.

> TestContainerLaunch, TestContainersMonitor, TestNodeManagerShutdown, 
> TestNodeStatusUpdater fails on Linux
> -
>
> Key: YARN-1798
> URL: https://issues.apache.org/jira/browse/YARN-1798
> Project: Hadoop YARN
>  Issue Type: Test
>Reporter: Tsuyoshi OZAWA
>Assignee: Tsuyoshi OZAWA
> Attachments: TestContainerLaunch-output.txt, TestContainerLaunch.txt, 
> YARN-1798.1.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)