[ https://issues.apache.org/jira/browse/HDFS-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gordon Wang updated HDFS-6505: ------------------------------ Summary: file is corrupt due to last block is marked as corrupt by mistake (was: Can not close file and file is corrupt due to last block is marked as corrupt) > file is corrupt due to last block is marked as corrupt by mistake > ----------------------------------------------------------------- > > Key: HDFS-6505 > URL: https://issues.apache.org/jira/browse/HDFS-6505 > Project: Hadoop HDFS > Issue Type: Bug > Affects Versions: 2.2.0 > Reporter: Gordon Wang > > After appending a file, client could not close it. Because namenode could not > complete the last block in file. The UC status of last block remained as > COMMIT and never change. > The namenode log was like this. > {code} > INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: BLOCK* > checkFileProgress: blk_1073741920_13948{blockUCState=COMMITTED, > primaryNodeIndex=-1, > replicas=[ReplicaUnderConstruction[172.28.1.2:50010|RBW]]} has not reached > minimal replication 1 > {code} > After going through the log of namenode, I found a log like this > {code} > INFO BlockStateChange: BLOCK NameSystem.addToCorruptReplicasMap: > blk_1073741920 added as corrupt on 172.28.1.2:50010 by sdw3/172.28.1.3 > because client machine reported it > {code} > But actually, the last block was finished successfully in the data node. > Because I could find the log in datanode > {code} > INFO org.apache.hadoop.hdfs.server.datanode.DataNode: DataTransfer: > Transmitted BP-649434182-172.28.1.251-1401432753616:blk_1073741920_13808 > (numBytes=50120352) to /172.28.1.3:50010 > INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: src: > /172.28.1.2:36860, dest: /172.28.1.2:50010, bytes: 51686616, op: HDFS_WRITE, > cliID: > libhdfs3_client_random_741511239_count_1_pid_215802_tid_140085714196576, > offset: 0, srvID: DS-2074102060-172.28.1.2-50010-1401432768690, blockid: > BP-649434182-172.28.1.251-1401432753616:blk_1073741920_13948, duration: > 189226453336 > INFO org.apache.hadoop.hdfs.server.datanode.DataNode: PacketResponder: > BP-649434182-172.28.1.251-1401432753616:blk_1073741920_13948, > type=LAST_IN_PIPELINE, downstreams=0:[] terminating > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)