[
https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300602#comment-15300602
]
Jing Zhao commented on HDFS-7240:
---------------------------------
Talking about EC in ozone, I had a general discussion with [~drankye] last week
while he was visiting us. We think ozone's storage container layer can make EC
work easier and more clean, especially considering we're planning the EC phase
II, i.e., to do EC in an offline mode.
Fundamentally EC/replication should be handled in the storage layer (i.e., the
block of HDFS, and the storage container in ozone) as two options for
maintaining data's durability. A ozone's storage container will have the
capability to support both. The general design to support EC in ozone can be
very similar to some existing object store such as [magic pocket |
https://blogs.dropbox.com/tech/2016/05/inside-the-magic-pocket/]. We can have
more detailed discussion about the design and finally have a section in the
design doc, but I do not think to support EC can become a hurdle for us.
> Object store in HDFS
> --------------------
>
> Key: HDFS-7240
> URL: https://issues.apache.org/jira/browse/HDFS-7240
> Project: Hadoop HDFS
> Issue Type: New Feature
> Reporter: Jitendra Nath Pandey
> Assignee: Jitendra Nath Pandey
> Attachments: Ozone-architecture-v1.pdf, ozone_user_v0.pdf
>
>
> This jira proposes to add object store capabilities into HDFS.
> As part of the federation work (HDFS-1052) we separated block storage as a
> generic storage layer. Using the Block Pool abstraction, new kinds of
> namespaces can be built on top of the storage layer i.e. datanodes.
> In this jira I will explore building an object store using the datanode
> storage, but independent of namespace metadata.
> I will soon update with a detailed design document.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
