Todd Lipcon created HDFS-3872:
---------------------------------

             Summary: Store block ID in block metadata header
                 Key: HDFS-3872
                 URL: https://issues.apache.org/jira/browse/HDFS-3872
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: data-node
    Affects Versions: 3.0.0
            Reporter: Todd Lipcon


We recently had an interesting local filesystem corruption in one cluster, 
which caused a block and its associated metadata file to get replaced with a 
data/meta pair from an entirely different replica. Because the block and its 
metadata were still self-consistent, the block scanner never noticed, and we 
ended up with a system where one replica differed from the others.

One simple solution to guard against this type of corruption in the future 
would be to put the block ID itself in the meta header, and have the block 
scanner verify it.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to