Hello everyone,
I would like to start this thread to discuss merging Ozone (HDFS-7240) to trunk. This feature implements an object store which can co-exist with HDFS. Ozone is disabled by default. We have tested Ozone with cluster sizes varying from 1 to 100 data nodes. The merge payload includes the following: 1. All services, management scripts 2. Object store APIs, exposed via both REST and RPC 3. Master service UIs, command line interfaces 4. Pluggable pipeline Integration 5. Ozone File System (Hadoop compatible file system implementation, passes all FileSystem contract tests) 6. Corona - a load generator for Ozone. 7. Essential documentation added to Hadoop site. 8. Version specific Ozone Documentation, accessible via service UI. 9. Docker support for ozone, which enables faster development cycles. To build Ozone and run ozone using docker, please follow instructions in this wiki page. https://cwiki.apache.org/confluence/display/HADOOP/Dev+cluster+with+docker. We have built a passionate and diverse community to drive this feature development. As a team, we have achieved significant progress in past 3 years since first JIRA for HDFS-7240 was opened on Oct 2014. So far, we have resolved almost 400 JIRAs by 20+ contributors/committers from different countries and affiliations. We also want to thank the large number of community members who were supportive of our efforts and contributed ideas and participated in the design of ozone. Please share your thoughts, thanks! -- Weiwei Yang