Uma Maheswara Rao G created HDFS-15760:
------------------------------------------

             Summary: Validate the target indices in ErasureCoding worker in 
reconstruction process
                 Key: HDFS-15760
                 URL: https://issues.apache.org/jira/browse/HDFS-15760
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: ec
    Affects Versions: 3.4.0
            Reporter: Uma Maheswara Rao G


As we have seen issues like 
 # HDFS-15186
 # HDFS-14768

It is a good idea to validate the indices at the ECWorker side and skip the 
unintended in indices from target list.

Both of the issues triggered because, NN accidentally scheduled for 
reconstruction in decom process due to busy node. We have fixed to make sure NN 
considers busy nodes as live replicas. However, it may be good idea to safe 
gaud the condition at ECWorker also in case if any other condition triggers and 
that leads ECWroker to calculate the indices similar the above issues, then EC 
function returns wrong o/p.  I think it's ok to recover only the missing 
indices from the given src indices.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Reply via email to