[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14294336#comment-14294336 ]
Jing Zhao commented on HDFS-7611: --------------------------------- I cannot reproduce the failure of TestOpenFilesWithSnapshot in my local environment. And the new Jenkins run did not complain it. Looks like this is intermittent. >From the log of the previous run looks like the DNs could not finish >registration and block report during {{waitClusterUp}}. Maybe this is related >to 1) slow environment, and 2) the client was still trying to write data to >DNs in the test thus triggered IBR which delayed the process further. We can >open a separate jira to track this if you think it's necessary. > deleteSnapshot and delete of a file can leave orphaned blocks in the > blocksMap on NameNode restart. > --------------------------------------------------------------------------------------------------- > > Key: HDFS-7611 > URL: https://issues.apache.org/jira/browse/HDFS-7611 > Project: Hadoop HDFS > Issue Type: Bug > Components: namenode > Affects Versions: 2.6.0 > Reporter: Konstantin Shvachko > Assignee: Byron Wong > Priority: Critical > Attachments: HDFS-7611.000.patch, HDFS-7611.001.patch, > HDFS-7611.002.patch, blocksNotDeletedTest.patch, testTruncateEditLogLoad.log > > > If quotas are enabled a combination of operations *deleteSnapshot* and > *delete* of a file can leave orphaned blocks in the blocksMap on NameNode > restart. They are counted as missing on the NameNode, and can prevent > NameNode from coming out of safeMode and could cause memory leak during > startup. -- This message was sent by Atlassian JIRA (v6.3.4#6332)