[
https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292351#comment-15292351
]
Zhe Zhang commented on HDFS-7240:
---------------------------------
Thanks for the discussions [~andrew.wang] [~anu].
I'm still trying to catch up all the new updates (looking forward to the
updated design doc, maybe also post the ApacheCon video?). Meanwhile, some
thoughts around EC:
bq. My biggest concern is that erasure coding is not a first-class
consideration in this system, and seems like it will be quite difficult to
implement.
I agree. The most difficult parts in building HDFS-EC was to remove /
generalize inflexible assumptions in HDFS block management and namespace logics
about replicas etc. So it would help a lot to at least conceptually discuss the
plan for EC implementation in the new design doc.
Another question about reading the ApacheCon slides: the question "Why an
Object Store" was well answered. How about "why an object store as part of
HDFS"? IIUC Ozone is only leveraging a very small portion of HDFS code. Why
should it be a part of HDFS instead of a separate project?
> Object store in HDFS
> --------------------
>
> Key: HDFS-7240
> URL: https://issues.apache.org/jira/browse/HDFS-7240
> Project: Hadoop HDFS
> Issue Type: New Feature
> Reporter: Jitendra Nath Pandey
> Assignee: Jitendra Nath Pandey
> Attachments: Ozone-architecture-v1.pdf, ozone_user_v0.pdf
>
>
> This jira proposes to add object store capabilities into HDFS.
> As part of the federation work (HDFS-1052) we separated block storage as a
> generic storage layer. Using the Block Pool abstraction, new kinds of
> namespaces can be built on top of the storage layer i.e. datanodes.
> In this jira I will explore building an object store using the datanode
> storage, but independent of namespace metadata.
> I will soon update with a detailed design document.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
