[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292351#comment-15292351 ]
Zhe Zhang commented on HDFS-7240: --------------------------------- Thanks for the discussions [~andrew.wang] [~anu]. I'm still trying to catch up all the new updates (looking forward to the updated design doc, maybe also post the ApacheCon video?). Meanwhile, some thoughts around EC: bq. My biggest concern is that erasure coding is not a first-class consideration in this system, and seems like it will be quite difficult to implement. I agree. The most difficult parts in building HDFS-EC was to remove / generalize inflexible assumptions in HDFS block management and namespace logics about replicas etc. So it would help a lot to at least conceptually discuss the plan for EC implementation in the new design doc. Another question about reading the ApacheCon slides: the question "Why an Object Store" was well answered. How about "why an object store as part of HDFS"? IIUC Ozone is only leveraging a very small portion of HDFS code. Why should it be a part of HDFS instead of a separate project? > Object store in HDFS > -------------------- > > Key: HDFS-7240 > URL: https://issues.apache.org/jira/browse/HDFS-7240 > Project: Hadoop HDFS > Issue Type: New Feature > Reporter: Jitendra Nath Pandey > Assignee: Jitendra Nath Pandey > Attachments: Ozone-architecture-v1.pdf, ozone_user_v0.pdf > > > This jira proposes to add object store capabilities into HDFS. > As part of the federation work (HDFS-1052) we separated block storage as a > generic storage layer. Using the Block Pool abstraction, new kinds of > namespaces can be built on top of the storage layer i.e. datanodes. > In this jira I will explore building an object store using the datanode > storage, but independent of namespace metadata. > I will soon update with a detailed design document. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org