[
https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15299197#comment-15299197
]
Andrew Wang commented on HDFS-7240:
-----------------------------------
[~arpitagarwal] the impedance mismatch here is illustrated in your most recent
comment:
bq. We will post a design doc soon and there is ample opportunity/need for
community contributions as the implementation is still in an early stage. This
is in line with how features are developed in Apache.
The Apache community is supposed to be involved in the design too, not just the
implementation. I thought we were doing this, since we had a nice design
discussion when the architecture doc was released, and when we last spoke in
late February this year, the design seemed unchanged from the design doc.
Since then, it's clear that a lot of work has been done internally at
Hortonworks, without community involvement. I consider changing how metadata is
stored to be a very significant design change, as well as the addition of a new
master service.
If the design is still flexible and under discussion, great. What it feels like
though is a completed design being dropped on us. It's hard for external
contributors to interpret these design changes without the related context and
discussions. If the design is viewed as completed and just needs
implementation, it's also hard for us to make meaningful design changes.
Again, I would love to collaborate with everyone on this project. HDFS scale is
a topic at the forefront of my mind, and we would all benefit from working
together on a single solution. But that requires opening it up so
non-Hortonworkers can be deeply involved in the requirements and design, not
just implementation.
> Object store in HDFS
> --------------------
>
> Key: HDFS-7240
> URL: https://issues.apache.org/jira/browse/HDFS-7240
> Project: Hadoop HDFS
> Issue Type: New Feature
> Reporter: Jitendra Nath Pandey
> Assignee: Jitendra Nath Pandey
> Attachments: Ozone-architecture-v1.pdf, ozone_user_v0.pdf
>
>
> This jira proposes to add object store capabilities into HDFS.
> As part of the federation work (HDFS-1052) we separated block storage as a
> generic storage layer. Using the Block Pool abstraction, new kinds of
> namespaces can be built on top of the storage layer i.e. datanodes.
> In this jira I will explore building an object store using the datanode
> storage, but independent of namespace metadata.
> I will soon update with a detailed design document.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
