[ https://issues.apache.org/jira/browse/HDFS-14720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16969399#comment-16969399 ]
Surendra Singh Lilhore commented on HDFS-14720: ----------------------------------------------- Hi [~hexiaoqiao], {quote}DataNode will leave one WARN log and ignore to transfer this block, later it will receive DELETE command at next heartbeat response then remove this block replica. {quote} It just not log the warn message , even it report badblock to namenode and increase the work load for namenode. {code:java} if (lengthTooShort) { // Check if NN recorded length matches on-disk length // Shorter on-disk len indicates corruption so report NN the corrupt block reportBadBlock(bpos, block, "Can't replicate block " + block + " because on-disk length " + data.getLength(block) + " is shorter than NameNode recorded length " + block.getNumBytes()); return; } {code} > DataNode shouldn't report block as bad block if the block length is > Long.MAX_VALUE. > ----------------------------------------------------------------------------------- > > Key: HDFS-14720 > URL: https://issues.apache.org/jira/browse/HDFS-14720 > Project: Hadoop HDFS > Issue Type: Bug > Components: datanode > Affects Versions: 3.1.1 > Reporter: Surendra Singh Lilhore > Assignee: hemanthboyina > Priority: Major > Attachments: HDFS-14720.001.patch > > > {noformat} > 2019-08-11 09:15:58,092 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: > Can't replicate block > BP-725378529-10.0.0.8-1410027444173:blk_13276745777_1112363330268 because > on-disk length 175085 is shorter than NameNode recorded length > 9223372036854775807.{noformat} > If the block length is Long.MAX_VALUE, means file belongs to this block is > deleted from the namenode and DN got the command after deletion of file. In > this case command should be ignored. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org