[
https://issues.apache.org/jira/browse/HDFS-5723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13863898#comment-13863898
]
Vinay commented on HDFS-5723:
-----------------------------
{noformat}2014-01-07 09:47:22,878 ERROR
org.apache.hadoop.hdfs.server.datanode.DataNode: <ip>:25012:DataXceiver error
processing WRITE_BLOCK operation src: /<ip>:56873 dest: /<ip2>:25012
org.apache.hadoop.hdfs.server.datanode.ReplicaNotFoundException: Cannot append
to a non-existent replica BP-1746676845-<ip>-1388725564463:blk_1073742062_1268
at
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.getReplicaInfo(FsDatasetImpl.java:372)
at
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.append(FsDatasetImpl.java:507)
at
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.append(FsDatasetImpl.java:93)
at
org.apache.hadoop.hdfs.server.datanode.BlockReceiver.<init>(BlockReceiver.java:200)
at
org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:457)
at
org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:115)
at
org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:68)
at
org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:221)
at java.lang.Thread.run(Thread.java:662){noformat}
{noformat}2014-01-07 09:47:46,773 ERROR
org.apache.hadoop.hdfs.server.datanode.DataNode: <ip>:25012:DataXceiver error
processing READ_BLOCK operation src: /<ip>:35125 dest: /<ip>:25012
java.io.IOException: Replica gen stamp < block genstamp,
block=BP-1746676845-<ip>-1388725564463:blk_1073742062_1270,
replica=FinalizedReplica, blk_1073742062_1266, FINALIZED
getNumBytes() = 6
getBytesOnDisk() = 6
getVisibleLength()= 6
getVolume() = /home/vinay/hadoop/dfs/data/current
getBlockFile() =
/home/vinay/hadoop/dfs/data/current/BP-1746676845-<ip>-1388725564463/current/finalized/blk_1073742062
unlinked =false
at
org.apache.hadoop.hdfs.server.datanode.BlockSender.<init>(BlockSender.java:247)
at
org.apache.hadoop.hdfs.server.datanode.DataXceiver.readBlock(DataXceiver.java:328)
at
org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opReadBlock(Receiver.java:101)
at
org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:65)
at
org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:221)
at java.lang.Thread.run(Thread.java:662){noformat}
> Append failed FINALIZED replica should not be accepted as valid when that
> block is underconstruction
> ----------------------------------------------------------------------------------------------------
>
> Key: HDFS-5723
> URL: https://issues.apache.org/jira/browse/HDFS-5723
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: namenode
> Affects Versions: 2.2.0
> Reporter: Vinay
>
> Scenario:
> 1. 3 node cluster with
> dfs.client.block.write.replace-datanode-on-failure.enable set to false.
> 2. One file is written with 3 replicas, blk_id_gs1
> 3. One of the datanode DN1 is down.
> 4. File was opened with append and some more data is added to the file and
> synced. (to only 2 live nodes DN2 and DN3)-- blk_id_gs2
> 5. Now DN1 restarted
> 6. In this block report, DN1 reported FINALIZED block blk_id_gs1, this should
> be made marked corrupted.
> but since NN having appended block state as UnderConstruction, at this time
> its not detecting this block as corrupt and adding to valid block locations.
> As long as the namenode is alive, this datanode also will be considered as
> valid replica and read/append will fail in that datanode.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
