[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17191048#comment-17191048 ]
Masatake Iwasaki commented on HDFS-15422: ----------------------------------------- The code was introduced by HDFS-2742 (in HDFS-1623 branch). I think the fix makes sense. I did not see relevant test failure on both QA build and my local. I'm trying to add test case (based on TestDNFencing#testQueueingWithAppend) for SIZE_MISMATCH after append mentioned by [~kihwal]. If I can not make it in a few days, I will update the target version to 2.10.2. > Reported IBR is partially replaced with stored info when queuing. > ----------------------------------------------------------------- > > Key: HDFS-15422 > URL: https://issues.apache.org/jira/browse/HDFS-15422 > Project: Hadoop HDFS > Issue Type: Bug > Components: namenode > Reporter: Kihwal Lee > Priority: Critical > Attachments: HDFS-15422-branch-2.10.001.patch > > > When queueing an IBR (incremental block report) on a standby namenode, some > of the reported information is being replaced with the existing stored > information. This can lead to false block corruption. > We had a namenode, after transitioning to active, started reporting missing > blocks with "SIZE_MISMATCH" as corrupt reason. These were blocks that were > appended and the sizes were actually correct on the datanodes. Upon further > investigation, it was determined that the namenode was queueing IBRs with > altered information. > Although it sounds bad, I am not making it blocker -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org