[ 
https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhe Zhang updated HDFS-7678:
----------------------------
    Attachment: HDFS-7678-HDFS-7285.003.patch

Attaching new patch which based on Andrew's comments.

# An overall timeout is enforced
# All data fetching happens in a single loop, leveraging Yi's idea under 
HDFS-7348
# It also refactors shared striped reading logic (among client and DN) to the 
util class. [~andrew.wang] / [~hitliuyi] could you take a look at the changes 
in {{StripedBlockUtil}}? If that part looks OK I'll split it to HDFS-8282 and 
get it in first, so this client decode JIRA doesn't block HDFS-7348.

> Erasure coding: DFSInputStream with decode functionality
> --------------------------------------------------------
>
>                 Key: HDFS-7678
>                 URL: https://issues.apache.org/jira/browse/HDFS-7678
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>    Affects Versions: HDFS-7285
>            Reporter: Li Bo
>            Assignee: Zhe Zhang
>         Attachments: BlockGroupReader.patch, HDFS-7678-HDFS-7285.002.patch, 
> HDFS-7678-HDFS-7285.003.patch, HDFS-7678.000.patch, HDFS-7678.001.patch
>
>
> A block group reader will read data from BlockGroup no matter in striping 
> layout or contiguous layout. The corrupt blocks can be known before 
> reading(told by namenode), or just be found during reading. The block group 
> reader needs to do decoding work when some blocks are found corrupt.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to