[ https://issues.apache.org/jira/browse/HDFS-8150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543493#comment-14543493 ]
Hudson commented on HDFS-8150: ------------------------------ FAILURE: Integrated in Hadoop-trunk-Commit #7831 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/7831/]) HDFS-8150. Make getFileChecksum fail for blocks under construction (Contributed by J.Andreina) (vinayakumarb: rev def9136e0259e118e6fd7b656260765d28ac9ae6) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/snapshot/TestSnapshotFileLength.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestGetFileChecksum.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt > Make getFileChecksum fail for blocks under construction > ------------------------------------------------------- > > Key: HDFS-8150 > URL: https://issues.apache.org/jira/browse/HDFS-8150 > Project: Hadoop HDFS > Issue Type: Bug > Reporter: Kihwal Lee > Assignee: J.Andreina > Priority: Critical > Fix For: 2.8.0 > > Attachments: HDFS-8150.1.patch, HDFS-8150.2.patch, HDFS-8150.3.patch > > > We have seen the cases of validating data copy using checksum then the > content of target changing. It turns out the target wasn't closed > successfully, so it was still under-construction. One hour later, a lease > recovery kicked in and truncated the block. > Although this can be prevented in many ways, if there is no valid use case > for getting file checksum from under-construction blocks, can it be disabled? > E.g. Datanode can throw an exception if the replica is not in the finalized > state. -- This message was sent by Atlassian JIRA (v6.3.4#6332)