[ https://issues.apache.org/jira/browse/HDFS-8669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938347#comment-14938347 ]
Hudson commented on HDFS-8669: ------------------------------ FAILURE: Integrated in Hadoop-Mapreduce-trunk #2408 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2408/]) HDFS-8669. Erasure Coding: handle missing internal block locations in (jing9: rev b1e6429a6be382c93e894e46f63037819a5608a6) * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestReadStripedFileWithMissingBlocks.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/BlockReader.java * hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-EC-7285.txt * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSStripedInputStream.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestWriteReadStripedFile.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/util/StripedBlockUtil.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/StripedFileTestUtil.java > Erasure Coding: handle missing internal block locations in > DFSStripedInputStream > -------------------------------------------------------------------------------- > > Key: HDFS-8669 > URL: https://issues.apache.org/jira/browse/HDFS-8669 > Project: Hadoop HDFS > Issue Type: Sub-task > Reporter: Jing Zhao > Assignee: Jing Zhao > Fix For: HDFS-7285 > > Attachments: HDFS-8669-HDFS-7285.001.patch, HDFS-8669.000.patch, > HDFS-8669.001.patch > > > Currently DFSStripedInputStream assumes we always have complete internal > block location information, i.e., we can always get all the DataNodes for a > striped block group. In a lot of scenarios the client cannot get complete > block location info, e.g., some internal blocks are missing and the NameNode > has not finished the recovery yet. We should add functionality to handle > missing block locations in DFSStripedInputStream. -- This message was sent by Atlassian JIRA (v6.3.4#6332)