[ https://issues.apache.org/jira/browse/HDFS-8863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707444#comment-14707444 ]
Hudson commented on HDFS-8863: ------------------------------ FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #294 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/294/]) HDFS-8863. The remaining space check in BlockPlacementPolicyDefault is flawed. (Kihwal Lee via yliu) (yliu: rev 5e8fe8943718309b5e39a794360aebccae28b331) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeDescriptor.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockPlacementPolicyDefault.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt > The remaining space check in BlockPlacementPolicyDefault is flawed > ------------------------------------------------------------------ > > Key: HDFS-8863 > URL: https://issues.apache.org/jira/browse/HDFS-8863 > Project: Hadoop HDFS > Issue Type: Bug > Affects Versions: 2.6.0 > Reporter: Kihwal Lee > Assignee: Kihwal Lee > Priority: Critical > Labels: 2.6.1-candidate > Fix For: 2.7.2 > > Attachments: HDFS-8863.patch, HDFS-8863.v2.patch, HDFS-8863.v3.patch > > > The block placement policy calls > {{DatanodeDescriptor#getRemaining(StorageType}}}} to check whether the block > is going to fit. Since the method is adding up all remaining spaces, namenode > can allocate a new block on a full node. This causes pipeline construction > failure and {{abandonBlock}}. If the cluster is nearly full, the client might > hit this multiple times and the write can fail permanently. -- This message was sent by Atlassian JIRA (v6.3.4#6332)