[
https://issues.apache.org/jira/browse/HADOOP-11828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14516731#comment-14516731
]
jack liuquan commented on HADOOP-11828:
---------------------------------------
Hi Kai,
bq. I mentioned that in my rough thought, would you clarify it in details and
provide your thoughts? This would be desired as it's a rather major design
change.
Hitchhiker algorithm builds on top of RS codes and XOR codes, it is more
suitable to put hitchhiker in ErasureCoder layer for architecture
consideration. And it is convenient to replace underlying RS codes and XOR
codes of Hitchhiker to get better performance in ErasureCoder layer.
bq.You're still using JRSRawEncoder, but it's renamed to RSRawEncoder quite
some time ago.
Oh yes, I see. I will check and modify it.
bq.How about naming the new coder HitchhikerXORErasureEncoder to
HHXORErasureEnoder? Similar to other coders.
OK, sounds great.
> Implement the Hitchhiker erasure coding algorithm
> -------------------------------------------------
>
> Key: HADOOP-11828
> URL: https://issues.apache.org/jira/browse/HADOOP-11828
> Project: Hadoop Common
> Issue Type: Sub-task
> Reporter: Zhe Zhang
> Assignee: jack liuquan
> Attachments: 7715-hitchhikerXOR-v2-testcode.patch,
> 7715-hitchhikerXOR-v2.patch, HADOOP-11828-hitchhikerXOR-V3.patch,
> HDFS-7715-hhxor-decoder.patch, HDFS-7715-hhxor-encoder.patch
>
>
> [Hitchhiker |
> http://www.eecs.berkeley.edu/~nihar/publications/Hitchhiker_SIGCOMM14.pdf] is
> a new erasure coding algorithm developed as a research project at UC
> Berkeley. It has been shown to reduce network traffic and disk I/O by 25%-45%
> during data reconstruction. This JIRA aims to introduce Hitchhiker to the
> HDFS-EC framework, as one of the pluggable codec algorithms.
> The existing implementation is based on HDFS-RAID.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
