Todd Lipcon created HDFS-3872: --------------------------------- Summary: Store block ID in block metadata header Key: HDFS-3872 URL: https://issues.apache.org/jira/browse/HDFS-3872 Project: Hadoop HDFS Issue Type: Improvement Components: data-node Affects Versions: 3.0.0 Reporter: Todd Lipcon
We recently had an interesting local filesystem corruption in one cluster, which caused a block and its associated metadata file to get replaced with a data/meta pair from an entirely different replica. Because the block and its metadata were still self-consistent, the block scanner never noticed, and we ended up with a system where one replica differed from the others. One simple solution to guard against this type of corruption in the future would be to put the block ID itself in the meta header, and have the block scanner verify it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira