[jira] [Commented] (HDFS-15411) TestNameNodeMXBean.testDecommissioningNodes fails

2020-06-15 Thread Ayush Saxena (Jira) 


[ 
https://issues.apache.org/jira/browse/HDFS-15411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135610#comment-17135610
 ] 

Ayush Saxena commented on HDFS-15411:
-

Thanx [~aajisaka] for reporting. I tried to reproduce this by putting a sleep 
at L367. The check failed but with different difference. This time being due to 
nonDFSUsed being different.  we should replace this check with a relaxed check..
{noformat}
Expected 
:{"127.0.0.1:39745":{"infoAddr":"127.0.0.1:35813","infoSecureAddr":"127.0.0.1:0","xferaddr":"127.0.0.1:39745","lastContact":0,"usedSpace":49152,"adminState":"In
 
Service","nonDfsUsedSpace":303558705152,"capacity":3935851380736,"numBlocks":0,"version":"3.4.0-SNAPSHOT","used":49152,"remaining":3432219295744,"blockScheduled":0,"blockPoolUsed":49152,"blockPoolUsedPercent":1.2488276E-6,"volfails":0,"lastBlockReport":0},"127.0.0.1:33467":{"infoAddr":"127.0.0.1:40379","infoSecureAddr":"127.0.0.1:0","xferaddr":"127.0.0.1:33467","lastContact":0,"usedSpace":49152,"adminState":"In
 
Service","nonDfsUsedSpace":303558705152,"capacity":3935851380736,"numBlocks":0,"version":"3.4.0-SNAPSHOT","used":49152,"remaining":3432219295744,"blockScheduled":0,"blockPoolUsed":49152,"blockPoolUsedPercent":1.2488276E-6,"volfails":0,"lastBlockReport":0},"127.0.0.1:44865":{"infoAddr":"127.0.0.1:44315","infoSecureAddr":"127.0.0.1:0","xferaddr":"127.0.0.1:44865","lastContact":0,"usedSpace":49152,"adminState":"In
 
Service","nonDfsUsedSpace":303558705152,"capacity":3935851380736,"numBlocks":0,"version":"3.4.0-SNAPSHOT","used":49152,"remaining":3432219295744,"blockScheduled":0,"blockPoolUsed":49152,"blockPoolUsedPercent":1.2488276E-6,"volfails":0,"lastBlockReport":0}}
Actual   
:{"127.0.0.1:39745":{"infoAddr":"127.0.0.1:35813","infoSecureAddr":"127.0.0.1:0","xferaddr":"127.0.0.1:39745","lastContact":0,"usedSpace":49152,"adminState":"In
 
Service","nonDfsUsedSpace":303558696960,"capacity":3935851380736,"numBlocks":0,"version":"3.4.0-SNAPSHOT","used":49152,"remaining":3432219303936,"blockScheduled":0,"blockPoolUsed":49152,"blockPoolUsedPercent":1.2488276E-6,"volfails":0,"lastBlockReport":0},"127.0.0.1:33467":{"infoAddr":"127.0.0.1:40379","infoSecureAddr":"127.0.0.1:0","xferaddr":"127.0.0.1:33467","lastContact":0,"usedSpace":49152,"adminState":"In
 
Service","nonDfsUsedSpace":303558696960,"capacity":3935851380736,"numBlocks":0,"version":"3.4.0-SNAPSHOT","used":49152,"remaining":3432219303936,"blockScheduled":0,"blockPoolUsed":49152,"blockPoolUsedPercent":1.2488276E-6,"volfails":0,"lastBlockReport":0},"127.0.0.1:44865":{"infoAddr":"127.0.0.1:44315","infoSecureAddr":"127.0.0.1:0","xferaddr":"127.0.0.1:44865","lastContact":0,"usedSpace":49152,"adminState":"In
 
Service","nonDfsUsedSpace":303558696960,"capacity":3935851380736,"numBlocks":0,"version":"3.4.0-SNAPSHOT","used":49152,"remaining":3432219303936,"blockScheduled":0,"blockPoolUsed":49152,"blockPoolUsedPercent":1.2488276E-6,"volfails":0,"lastBlockReport":0}}

{noformat}

> TestNameNodeMXBean.testDecommissioningNodes fails
> -
>
> Key: HDFS-15411
> URL: https://issues.apache.org/jira/browse/HDFS-15411
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: test
>Reporter: Akira Ajisaka
>Priority: Major
>
> https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/172/testReport/org.apache.hadoop.hdfs.server.namenode/TestNameNodeMXBean/testDecommissioningNodes/
> {noformat}
> org.junit.ComparisonFailure: 
> expected:<...0,"lastBlockReport":[0},"127.0.0.1:35473":{"infoAddr":"127.0.0.1:38399","infoSecureAddr":"127.0.0.1:0","xferaddr":"127.0.0.1:35473","lastContact":0,"usedSpace":49152,"adminState":"In
>  
> Service","nonDfsUsedSpace":325285158912,"capacity":7871746113536,"numBlocks":0,"version":"3.4.0-SNAPSHOT","used":49152,"remaining":7146454327296,"blockScheduled":0,"blockPoolUsed":49152,"blockPoolUsedPercent":6.244104E-7,"volfails":0,"lastBlockReport":0},"127.0.0.1:44811":{"infoAddr":"127.0.0.1:39743","infoSecureAddr":"127.0.0.1:0","xferaddr":"127.0.0.1:44811","lastContact":0,"usedSpace":49152,"adminState":"In
>  
> Service","nonDfsUsedSpace":325285158912,"capacity":7871746113536,"numBlocks":0,"version":"3.4.0-SNAPSHOT","used":49152,"remaining":7146454327296,"blockScheduled":0,"blockPoolUsed":49152,"blockPoolUsedPercent":6.244104E-7,"volfails":0,"lastBlockReport":0]}}>
>  but 
> was:<...0,"lastBlockReport":[362603},"127.0.0.1:35473":{"infoAddr":"127.0.0.1:38399","infoSecureAddr":"127.0.0.1:0","xferaddr":"127.0.0.1:35473","lastContact":0,"usedSpace":49152,"adminState":"In
>  
>

[jira] [Commented] (HDFS-15411) TestNameNodeMXBean.testDecommissioningNodes fails

2020-06-15 Thread Akira Ajisaka (Jira) 


[ 
https://issues.apache.org/jira/browse/HDFS-15411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135448#comment-17135448
 ] 

Akira Ajisaka commented on HDFS-15411:
--

It seems that the value of lastBlockReport has been updated between 
{code}
  String liveNodesInfo = (String) (mbs.getAttribute(mxbeanName,
  "LiveNodes"));
{code}
and
{code}
  assertEquals(fsn.getLiveNodes(), liveNodesInfo);
{code}

I think the assertion seems too strict.

> TestNameNodeMXBean.testDecommissioningNodes fails
> -
>
> Key: HDFS-15411
> URL: https://issues.apache.org/jira/browse/HDFS-15411
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: test
>Reporter: Akira Ajisaka
>Priority: Major
>
> https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/172/testReport/org.apache.hadoop.hdfs.server.namenode/TestNameNodeMXBean/testDecommissioningNodes/
> {noformat}
> org.junit.ComparisonFailure: 
> expected:<...0,"lastBlockReport":[0},"127.0.0.1:35473":{"infoAddr":"127.0.0.1:38399","infoSecureAddr":"127.0.0.1:0","xferaddr":"127.0.0.1:35473","lastContact":0,"usedSpace":49152,"adminState":"In
>  
> Service","nonDfsUsedSpace":325285158912,"capacity":7871746113536,"numBlocks":0,"version":"3.4.0-SNAPSHOT","used":49152,"remaining":7146454327296,"blockScheduled":0,"blockPoolUsed":49152,"blockPoolUsedPercent":6.244104E-7,"volfails":0,"lastBlockReport":0},"127.0.0.1:44811":{"infoAddr":"127.0.0.1:39743","infoSecureAddr":"127.0.0.1:0","xferaddr":"127.0.0.1:44811","lastContact":0,"usedSpace":49152,"adminState":"In
>  
> Service","nonDfsUsedSpace":325285158912,"capacity":7871746113536,"numBlocks":0,"version":"3.4.0-SNAPSHOT","used":49152,"remaining":7146454327296,"blockScheduled":0,"blockPoolUsed":49152,"blockPoolUsedPercent":6.244104E-7,"volfails":0,"lastBlockReport":0]}}>
>  but 
> was:<...0,"lastBlockReport":[362603},"127.0.0.1:35473":{"infoAddr":"127.0.0.1:38399","infoSecureAddr":"127.0.0.1:0","xferaddr":"127.0.0.1:35473","lastContact":0,"usedSpace":49152,"adminState":"In
>  
> Service","nonDfsUsedSpace":325285158912,"capacity":7871746113536,"numBlocks":0,"version":"3.4.0-SNAPSHOT","used":49152,"remaining":7146454327296,"blockScheduled":0,"blockPoolUsed":49152,"blockPoolUsedPercent":6.244104E-7,"volfails":0,"lastBlockReport":362603},"127.0.0.1:44811":{"infoAddr":"127.0.0.1:39743","infoSecureAddr":"127.0.0.1:0","xferaddr":"127.0.0.1:44811","lastContact":0,"usedSpace":49152,"adminState":"In
>  
> Service","nonDfsUsedSpace":325285158912,"capacity":7871746113536,"numBlocks":0,"version":"3.4.0-SNAPSHOT","used":49152,"remaining":7146454327296,"blockScheduled":0,"blockPoolUsed":49152,"blockPoolUsedPercent":6.244104E-7,"volfails":0,"lastBlockReport":362603]}}>
>   at org.junit.Assert.assertEquals(Assert.java:115)
>   at org.junit.Assert.assertEquals(Assert.java:144)
>   at 
> org.apache.hadoop.hdfs.server.namenode.TestNameNodeMXBean.testDecommissioningNodes(TestNameNodeMXBean.java:369)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
>   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
>   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
>   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
>   at 
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
>   at 
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   at java.lang.Thread.run(Thread.java:748)
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org