daimin created HDFS-16286:
-----------------------------

             Summary: Debug tool to verify the correctness of erasure coding on 
file
                 Key: HDFS-16286
                 URL: https://issues.apache.org/jira/browse/HDFS-16286
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: erasure-coding, tools
    Affects Versions: 3.3.1, 3.3.0
            Reporter: daimin
            Assignee: daimin


Block data in erasure coded block group may corrupt and the block meta 
(checksum) is unable to discover the corruption in some cases such as EC 
reconstruction, related issues are:  HDFS-14768, HDFS-15186, HDFS-15240.

In addition to HDFS-15759, there needs a tool to check erasure coded file 
whether any block group has data corruption in case of other conditions rather 
than EC reconstruction, or the feature HDFS-15759(validation during EC 
reconstruction) is not open(which is close by default now).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Reply via email to