[ https://issues.apache.org/jira/browse/HDFS-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716058#comment-14716058 ]
Hudson commented on HDFS-8248: ------------------------------ SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2257 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2257/]) HDFS-8248. Store INodeId instead of the INodeFile object in BlockInfoContiguous. Contributed by Haohui Mai. (wheat9: rev 4cbbfa2220e884e91bf18ad1cc2f3b11f895f8c9) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Namesystem.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/SequentialBlockIdGenerator.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/snapshot/TestSnapshotDeletion.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlocksMap.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DecommissionManager.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockInfo.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeId.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockManager.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/snapshot/TestSnapshotBlocksMap.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestCommitBlockSynchronization.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockCollection.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfo.java > Store INodeId instead of the INodeFile object in BlockInfoContiguous > -------------------------------------------------------------------- > > Key: HDFS-8248 > URL: https://issues.apache.org/jira/browse/HDFS-8248 > Project: Hadoop HDFS > Issue Type: Sub-task > Reporter: Haohui Mai > Assignee: Haohui Mai > Fix For: 2.8.0 > > Attachments: HDFS-8248.000.patch, HDFS-8248.001.patch, > HDFS-8248.002.patch, HDFS-8248.003.patch, HDFS-8248.004.patch, > HDFS-8248.005.patch, HDFS-8248.006.patch, HDFS-8248.007.patch, > HDFS-8248.008.patch > > > Currently the namespace and the block manager are tightly coupled together. > There are two couplings in terms of implementation: > 1. The {{BlockInfoContiguous}} stores a reference of the {{INodeFile}} that > owns the block, so that the block manager can look up the corresponding file > when replicating blocks, recovering from pipeline failures, etc. > 1. The {{INodeFile}} stores {{BlockInfoContiguous}} objects that the file > owns. > Decoupling the namespace and the block manager allows the BM to be separated > out from the Java heap or even as a standalone process. This jira proposes to > remove the first coupling by storing the id of the inode instead of the > object reference of {{INodeFile}} in the {{BlockInfoContiguous}} class. -- This message was sent by Atlassian JIRA (v6.3.4#6332)