Ruinan Gu created HDFS-16566:
--------------------------------

             Summary: Erasure Coding: Recovery may causes excess replicas when 
busy DN exsits
                 Key: HDFS-16566
                 URL: https://issues.apache.org/jira/browse/HDFS-16566
             Project: Hadoop HDFS
          Issue Type: Bug
    Affects Versions: 3.3.2
            Reporter: Ruinan Gu


Simple case: RS3-2 ,[0(busy),2,3,4] (1 missing), liveblockIndice=[2,3,4], 
additionalRepl=1.So the DN will get the LiveBitSet=[2,3,4] and targets.length=1.

According to StripedWriter.initTargetIndices(), 0 will get recovered instead of 
1. So the internal blocks will become [0(busy),2,3,4,0'(excess)].Although NN 
will detect, delete the excess replicas and recover the missing block(1) 
correctly after the wrong recovery of 0', I don't think this process is 
expected and the recovery of 0' is obviously wrong and not necessary.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Reply via email to