[ 
https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300518#comment-15300518
 ] 

Andrew Wang commented on HDFS-7240:
-----------------------------------

Sorry, hit reply too early. Quoting from my earlier response to Anu:

bq. Really though, even if the community hadn't explicitly expressed interest, 
all of this activity should still have been done in a public forum. It's very 
hard for newcomers to ramp up unless design discussions are being done publicly.

This is how software is supposed to be developed at Apache, so everyone can 
watch and contribute. It's not a reasonable standard to require each of the 160 
watchers on this JIRA to explicitly reach out to be involved in the 
conversation. And, like I said above, it's very hard to contribute at this 
conversation is happening publicly.

I'm a bit annoyed here since we did reach out in late Feb, and we had a nice 
design convo. We discussed the need for range instead of hash partitioning 
(which I'm happy to see made it), as well as the overhead of doing metadata and 
data lookups (which could motivate storing Ozone metadata in Raft instead of in 
a container). Then, as now, I also asked to be involved in the design 
discussions since this is a topic I'm very interested in. Here, I'm also trying 
to be as constructive as possible, raising questions as well as proposing 
possible solutions.

I keep saying this, but I would like to collaborate on this project. If you're 
willing to revisit some of the design points we're discussing above, we can put 
the past behind us and move forward. So far though it feels like I'm being 
rebuffed.

> Object store in HDFS
> --------------------
>
>                 Key: HDFS-7240
>                 URL: https://issues.apache.org/jira/browse/HDFS-7240
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jitendra Nath Pandey
>         Attachments: Ozone-architecture-v1.pdf, ozone_user_v0.pdf
>
>
> This jira proposes to add object store capabilities into HDFS. 
> As part of the federation work (HDFS-1052) we separated block storage as a 
> generic storage layer. Using the Block Pool abstraction, new kinds of 
> namespaces can be built on top of the storage layer i.e. datanodes.
> In this jira I will explore building an object store using the datanode 
> storage, but independent of namespace metadata.
> I will soon update with a detailed design document.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to