[ https://issues.apache.org/jira/browse/HDFS-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15000559#comment-15000559 ]
Kihwal Lee commented on HDFS-9396: ---------------------------------- {noformat} ------------------------------------------------------- T E S T S ------------------------------------------------------- Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestHFlush Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.082 sec - in org.apache.hadoop.hdfs.TestHFlush Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.datanode.TestDataNodeMetrics Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 68.543 sec - in org.apache.hadoop.hdfs.server.datanode.TestDataNodeMetrics Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.datanode.TestDirectoryScanner Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 147.408 sec - in org.apache.hadoop.hdfs.server.datanode.TestDirectoryScanner Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestDeadDatanode Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.382 sec - in org.apache.hadoop.hdfs.server.namenode.TestDeadDatanode Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestEditLogTailer Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.374 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestEditLogTailer Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 127.013 sec <<< FAILURE! - in org.apache.hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes testCircularLinkedListWrites(org.apache.hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes) Time elapsed: 126.826 sec <<< FAILURE! java.lang.AssertionError: Some writers didn't complete in expected runtime! Current writer state:[Circular Writer: directory: /test-1 target length: 50 current item: 1 done: false ] expected:<0> but was:<1> at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failNotEquals(Assert.java:743) at org.junit.Assert.assertEquals(Assert.java:118) at org.junit.Assert.assertEquals(Assert.java:555) at org.apache.hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes.testCircularLinkedListWrites(TestSeveralNameNodes.java:90) Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 102.884 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitCache Tests run: 11, Failures: 0, Errors: 0, Skipped: 6, Time elapsed: 1.192 sec - in org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitCache Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestEncryptedTransfer Tests run: 26, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 127.527 sec - in org.apache.hadoop.hdfs.TestEncryptedTransfer Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.security.TestDelegationTokenForProxyUser Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.674 sec - in org.apache.hadoop.hdfs.security.TestDelegationTokenForProxyUser {noformat} When run on my machine, all failed test cases but {{TestSeveralNameNodes}} pass. This is not related to the patch and will be addressed in HDFS-9376. > Total files and directories on jmx and web UI on standby is uninitialized > ------------------------------------------------------------------------- > > Key: HDFS-9396 > URL: https://issues.apache.org/jira/browse/HDFS-9396 > Project: Hadoop HDFS > Issue Type: Bug > Reporter: Kihwal Lee > Assignee: Kihwal Lee > Priority: Blocker > Attachments: HDFS-9396.patch, HDFS-9396.v2.patch > > > After HDFS-6763, the quota on the standby namenode is not being updated until > it transitions to active. This causes the jmx and the web ui files and dir > count to be uninitialized or unupdated. In some cases it shows a negative > number. > It is because the legacy way of getting the inode count, which existed since > before the creation of inode table. It relies on the root inode's quota being > properly updated. We can make it simply return the size of the inode table. -- This message was sent by Atlassian JIRA (v6.3.4#6332)