Re: [DISCUSS] Incubating Proposal for OpenDAL
Hi, Project looks promising! +1 (binding) Kind regards, Furkan Kamaci On Tue, Feb 21, 2023 at 4:39 PM tison wrote: > I have started a VOTE thread for accepting OpenDAL on > https://lists.apache.org/thread/3v9g2nk734m2zplrq1fgozc7xt169bgt. Welcome > to vote in the dedicated thread :) > > Best, > tison. > > > Xiaoqiao He 于2023年2月20日周一 00:41写道： > > > +1. Good luck! > > > > Thanks for starting this thread, tison! > > > > I'm glad to be one mentor of this project. > > Hope this interesting project could be accepted by apache incubator, and > > push forward more > > healthily and build a better community! > > > > Best Regards, > > - He Xiaoqiao > > > > On Sun, Feb 19, 2023 at 21:58 Xin Wang wrote: > > > > > +1 > > > Thanks for the interesting proposal! > > > OpenDAL reduces the complexity of users' use of cloud storage services. > > And > > > look forward to a growing and healthy community during the incubation > > > period. > > > > > > Sheng Wu 于2023年2月19日周日 17:06写道： > > > > > > > It is good to see you make the preparation ready so quickly. > > > > Hope you woenjobe benefit of joining the ASF for.building a more > > diverse > > > > and bigger community. > > > > > > > > hulk 于2023年2月19日 周日16:42写道： > > > > > > > > > +1, good luck. > > > > > > > > > > On Sun, 19 Feb 2023 at 10:18, tison wrote: > > > > > > > > > > > > @Xuanwo: Updated. > > > > > > > > > > > > Best, > > > > > > tison. > > > > > > > > > > > > > > > > > > Xuanwo 于2023年2月19日周日 08:54写道： > > > > > > > > > > > > > @Kimm King, thanks for pointing this out! > > > > > > > > > > > > > > I did a double check on all the deps marked as Apache 2.0 with > > the > > > > LLVM > > > > > > > exception. The result is that > > > io-lifetimes,linux-raw-sys,rustix,wasi > > > > > are > > > > > > > all triple-licensed under Apache 2.0 with the LLVM Exception, > > > Apache > > > > > 2.0 > > > > > > > and MIT terms. I think they should be OK to use them as Apache > > 2.0. > > > > > > > > > > > > > > @tison, can you help update the proposal to change all deps > under > > > > > Apache > > > > > > > 2.0 with the LLVM exception to Apache 2.0? > > > > > > > > > > > > > > On Sun, Feb 19, 2023, at 00:17, KimmKing wrote: > > > > > > > > +1, it is a "delicious" project. > > > > > > > > > > > > > > > > > > > > > > > > BTW: "Apache-2.0 WITH LLVM-exception (5)" should be > > > > > modified/removed in > > > > > > > future? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > > > > > > > > > Kimm King(kimmk...@apache.org/kimmk...@163.com) > > > > > > > > Apache Dubbo PMC Member > > > > > > > > github: kimmking > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > At 2023-02-17 21:12:59, "Willem Jiang" < > willem.ji...@gmail.com > > > > > > > > wrote: > > > > > > > >>+1, it's an interesting project. I'd like to be a mentor of > > this > > > > > project. > > > > > > > >>BTW, even though there are 37 contributors, I found Xuanwo > did > > > > most > > > > > > > >>of the development, which is not a good bus factor[1] of this > > > > > project. > > > > > > > >>We can make it better during the incubating process. > > > > > > > >> > > > > > > > >>[1]https://en.wikipedia.org/wiki/Bus_factor > > > > > > > >> > > > > > > > >> > > > > > > > >>Willem Jiang > > > > > > > >> > > > > > > > >>Twitter: willemjiang > > > > > > > >>Weibo: 姜宁willem > > > > > > > >> > > > > > > > >>On Fri, Feb 17, 2023 at 7:22 AM tison > > > > wrote: > > > > > > > >>> > > > > > > > >>> Hi IPMC, > > > > > > > >>> > > > > > > > >>> I would like to propose OpenDAL[1] as a new apache > incubator > > > > > project, > > > > > > > you > > > > > > > >>> can find the proposal[2] of OpenDAL for more detail. > > > > > > > >>> > > > > > > > >>> [1] https://github.com/datafuselabs/opendal > > > > > > > >>> [2] > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/INCUBATOR/OpenDAL+Proposal > > > > > > > >>> > > > > > > > >>> Best, > > > > > > > >>> tison. > > > > > > > >>> > > > > > > > >>> Full text of the proposal below: > > > > > > > >>> > > > > > > > >>> ## Abstract > > > > > > > >>> > > > > > > > >>> OpenDAL means “Open Data Access Layer”. It’s a Rust library > > > that > > > > > helps > > > > > > > >>> developers access data freely, painlessly, and efficiently > > over > > > > > > > multiple > > > > > > > >>> services, including AWS S3, HDFS, POSIX-compatible file > > > systems, > > > > > and > > > > > > > so on. > > > > > > > >>> > > > > > > > >>> ## Proposal > > > > > > > >>> > > > > > > > >>> OpenDAL provides the following features to support > developers > > > > > accessing > > > > > > > >>> data freely, painlessly, and efficiently: > > > > > > > >>> > > > > > > > >>> - Freely > > > > > > > >>> - Access different storage services in the same way > > > > > > > >>> - Behavior tests for all services > > > > > > > >>> - Cross-language/project bindings (working in progress) >
Re: [DISCUSS] Incubating Proposal for OpenDAL
I have started a VOTE thread for accepting OpenDAL on https://lists.apache.org/thread/3v9g2nk734m2zplrq1fgozc7xt169bgt. Welcome to vote in the dedicated thread :) Best, tison. Xiaoqiao He 于2023年2月20日周一 00:41写道： > +1. Good luck! > > Thanks for starting this thread, tison! > > I'm glad to be one mentor of this project. > Hope this interesting project could be accepted by apache incubator, and > push forward more > healthily and build a better community! > > Best Regards, > - He Xiaoqiao > > On Sun, Feb 19, 2023 at 21:58 Xin Wang wrote: > > > +1 > > Thanks for the interesting proposal! > > OpenDAL reduces the complexity of users' use of cloud storage services. > And > > look forward to a growing and healthy community during the incubation > > period. > > > > Sheng Wu 于2023年2月19日周日 17:06写道： > > > > > It is good to see you make the preparation ready so quickly. > > > Hope you woenjobe benefit of joining the ASF for.building a more > diverse > > > and bigger community. > > > > > > hulk 于2023年2月19日 周日16:42写道： > > > > > > > +1, good luck. > > > > > > > > On Sun, 19 Feb 2023 at 10:18, tison wrote: > > > > > > > > > > @Xuanwo: Updated. > > > > > > > > > > Best, > > > > > tison. > > > > > > > > > > > > > > > Xuanwo 于2023年2月19日周日 08:54写道： > > > > > > > > > > > @Kimm King, thanks for pointing this out! > > > > > > > > > > > > I did a double check on all the deps marked as Apache 2.0 with > the > > > LLVM > > > > > > exception. The result is that > > io-lifetimes,linux-raw-sys,rustix,wasi > > > > are > > > > > > all triple-licensed under Apache 2.0 with the LLVM Exception, > > Apache > > > > 2.0 > > > > > > and MIT terms. I think they should be OK to use them as Apache > 2.0. > > > > > > > > > > > > @tison, can you help update the proposal to change all deps under > > > > Apache > > > > > > 2.0 with the LLVM exception to Apache 2.0? > > > > > > > > > > > > On Sun, Feb 19, 2023, at 00:17, KimmKing wrote: > > > > > > > +1, it is a "delicious" project. > > > > > > > > > > > > > > > > > > > > > BTW: "Apache-2.0 WITH LLVM-exception (5)" should be > > > > modified/removed in > > > > > > future? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > > > > > > > Kimm King(kimmk...@apache.org/kimmk...@163.com) > > > > > > > Apache Dubbo PMC Member > > > > > > > github: kimmking > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > At 2023-02-17 21:12:59, "Willem Jiang" > > > > > wrote: > > > > > > >>+1, it's an interesting project. I'd like to be a mentor of > this > > > > project. > > > > > > >>BTW, even though there are 37 contributors, I found Xuanwo did > > > most > > > > > > >>of the development, which is not a good bus factor[1] of this > > > > project. > > > > > > >>We can make it better during the incubating process. > > > > > > >> > > > > > > >>[1]https://en.wikipedia.org/wiki/Bus_factor > > > > > > >> > > > > > > >> > > > > > > >>Willem Jiang > > > > > > >> > > > > > > >>Twitter: willemjiang > > > > > > >>Weibo: 姜宁willem > > > > > > >> > > > > > > >>On Fri, Feb 17, 2023 at 7:22 AM tison > > > wrote: > > > > > > >>> > > > > > > >>> Hi IPMC, > > > > > > >>> > > > > > > >>> I would like to propose OpenDAL[1] as a new apache incubator > > > > project, > > > > > > you > > > > > > >>> can find the proposal[2] of OpenDAL for more detail. > > > > > > >>> > > > > > > >>> [1] https://github.com/datafuselabs/opendal > > > > > > >>> [2] > > > > > > > > > https://cwiki.apache.org/confluence/display/INCUBATOR/OpenDAL+Proposal > > > > > > >>> > > > > > > >>> Best, > > > > > > >>> tison. > > > > > > >>> > > > > > > >>> Full text of the proposal below: > > > > > > >>> > > > > > > >>> ## Abstract > > > > > > >>> > > > > > > >>> OpenDAL means “Open Data Access Layer”. It’s a Rust library > > that > > > > helps > > > > > > >>> developers access data freely, painlessly, and efficiently > over > > > > > > multiple > > > > > > >>> services, including AWS S3, HDFS, POSIX-compatible file > > systems, > > > > and > > > > > > so on. > > > > > > >>> > > > > > > >>> ## Proposal > > > > > > >>> > > > > > > >>> OpenDAL provides the following features to support developers > > > > accessing > > > > > > >>> data freely, painlessly, and efficiently: > > > > > > >>> > > > > > > >>> - Freely > > > > > > >>> - Access different storage services in the same way > > > > > > >>> - Behavior tests for all services > > > > > > >>> - Cross-language/project bindings (working in progress) > > > > > > >>> - Painlessly > > > > > > >>> - **100%** of documents covered > > > > > > >>> - Powerful [Layers]( > > > > > > >>> https://opendal.databend.rs/opendal/layers/index.html) > > > > > > >>> - Automatic [retry]( > > > > > > >>> > > > https://opendal.databend.rs/opendal/layers/struct.RetryLayer.html) > > > > > > support > > > > > > >>> - Full observability support: [logging]( > > > > > > >>> > > > >
Re: [DISCUSS] Incubating Proposal for OpenDAL
+1. Good luck! Thanks for starting this thread, tison! I'm glad to be one mentor of this project. Hope this interesting project could be accepted by apache incubator, and push forward more healthily and build a better community! Best Regards, - He Xiaoqiao On Sun, Feb 19, 2023 at 21:58 Xin Wang wrote: > +1 > Thanks for the interesting proposal! > OpenDAL reduces the complexity of users' use of cloud storage services. And > look forward to a growing and healthy community during the incubation > period. > > Sheng Wu 于2023年2月19日周日 17:06写道： > > > It is good to see you make the preparation ready so quickly. > > Hope you woenjobe benefit of joining the ASF for.building a more diverse > > and bigger community. > > > > hulk 于2023年2月19日 周日16:42写道： > > > > > +1, good luck. > > > > > > On Sun, 19 Feb 2023 at 10:18, tison wrote: > > > > > > > > @Xuanwo: Updated. > > > > > > > > Best, > > > > tison. > > > > > > > > > > > > Xuanwo 于2023年2月19日周日 08:54写道： > > > > > > > > > @Kimm King, thanks for pointing this out! > > > > > > > > > > I did a double check on all the deps marked as Apache 2.0 with the > > LLVM > > > > > exception. The result is that > io-lifetimes,linux-raw-sys,rustix,wasi > > > are > > > > > all triple-licensed under Apache 2.0 with the LLVM Exception, > Apache > > > 2.0 > > > > > and MIT terms. I think they should be OK to use them as Apache 2.0. > > > > > > > > > > @tison, can you help update the proposal to change all deps under > > > Apache > > > > > 2.0 with the LLVM exception to Apache 2.0? > > > > > > > > > > On Sun, Feb 19, 2023, at 00:17, KimmKing wrote: > > > > > > +1, it is a "delicious" project. > > > > > > > > > > > > > > > > > > BTW: "Apache-2.0 WITH LLVM-exception (5)" should be > > > modified/removed in > > > > > future? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > > > > > Kimm King(kimmk...@apache.org/kimmk...@163.com) > > > > > > Apache Dubbo PMC Member > > > > > > github: kimmking > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > At 2023-02-17 21:12:59, "Willem Jiang" > > > wrote: > > > > > >>+1, it's an interesting project. I'd like to be a mentor of this > > > project. > > > > > >>BTW, even though there are 37 contributors, I found Xuanwo did > > most > > > > > >>of the development, which is not a good bus factor[1] of this > > > project. > > > > > >>We can make it better during the incubating process. > > > > > >> > > > > > >>[1]https://en.wikipedia.org/wiki/Bus_factor > > > > > >> > > > > > >> > > > > > >>Willem Jiang > > > > > >> > > > > > >>Twitter: willemjiang > > > > > >>Weibo: 姜宁willem > > > > > >> > > > > > >>On Fri, Feb 17, 2023 at 7:22 AM tison > > wrote: > > > > > >>> > > > > > >>> Hi IPMC, > > > > > >>> > > > > > >>> I would like to propose OpenDAL[1] as a new apache incubator > > > project, > > > > > you > > > > > >>> can find the proposal[2] of OpenDAL for more detail. > > > > > >>> > > > > > >>> [1] https://github.com/datafuselabs/opendal > > > > > >>> [2] > > > > > > > https://cwiki.apache.org/confluence/display/INCUBATOR/OpenDAL+Proposal > > > > > >>> > > > > > >>> Best, > > > > > >>> tison. > > > > > >>> > > > > > >>> Full text of the proposal below: > > > > > >>> > > > > > >>> ## Abstract > > > > > >>> > > > > > >>> OpenDAL means “Open Data Access Layer”. It’s a Rust library > that > > > helps > > > > > >>> developers access data freely, painlessly, and efficiently over > > > > > multiple > > > > > >>> services, including AWS S3, HDFS, POSIX-compatible file > systems, > > > and > > > > > so on. > > > > > >>> > > > > > >>> ## Proposal > > > > > >>> > > > > > >>> OpenDAL provides the following features to support developers > > > accessing > > > > > >>> data freely, painlessly, and efficiently: > > > > > >>> > > > > > >>> - Freely > > > > > >>> - Access different storage services in the same way > > > > > >>> - Behavior tests for all services > > > > > >>> - Cross-language/project bindings (working in progress) > > > > > >>> - Painlessly > > > > > >>> - **100%** of documents covered > > > > > >>> - Powerful [Layers]( > > > > > >>> https://opendal.databend.rs/opendal/layers/index.html) > > > > > >>> - Automatic [retry]( > > > > > >>> > > https://opendal.databend.rs/opendal/layers/struct.RetryLayer.html) > > > > > support > > > > > >>> - Full observability support: [logging]( > > > > > >>> > > > https://opendal.databend.rs/opendal/layers/struct.LoggingLayer.html > > > > > >>> ), [tracing]( > > > > > >>> > > > https://opendal.databend.rs/opendal/layers/struct.TracingLayer.html), > > > > > and > > > > > >>> [metrics]( > > > > > >>> > > > https://opendal.databend.rs/opendal/layers/struct.MetricsLayer.html). > > > > > >>> - Native chaos testing > > > > > >>> - Native service-side encryption support > > > > > >>> - Efficiently > > > > > >>> - Zero cost: mapping to underlying API calls directly > > > > > >>> - Best effort: auto-pick the best
Re: [DISCUSS] Incubating Proposal for OpenDAL
+1 Thanks for the interesting proposal! OpenDAL reduces the complexity of users' use of cloud storage services. And look forward to a growing and healthy community during the incubation period. Sheng Wu 于2023年2月19日周日 17:06写道： > It is good to see you make the preparation ready so quickly. > Hope you woenjobe benefit of joining the ASF for.building a more diverse > and bigger community. > > hulk 于2023年2月19日 周日16:42写道： > > > +1, good luck. > > > > On Sun, 19 Feb 2023 at 10:18, tison wrote: > > > > > > @Xuanwo: Updated. > > > > > > Best, > > > tison. > > > > > > > > > Xuanwo 于2023年2月19日周日 08:54写道： > > > > > > > @Kimm King, thanks for pointing this out! > > > > > > > > I did a double check on all the deps marked as Apache 2.0 with the > LLVM > > > > exception. The result is that io-lifetimes,linux-raw-sys,rustix,wasi > > are > > > > all triple-licensed under Apache 2.0 with the LLVM Exception, Apache > > 2.0 > > > > and MIT terms. I think they should be OK to use them as Apache 2.0. > > > > > > > > @tison, can you help update the proposal to change all deps under > > Apache > > > > 2.0 with the LLVM exception to Apache 2.0? > > > > > > > > On Sun, Feb 19, 2023, at 00:17, KimmKing wrote: > > > > > +1, it is a "delicious" project. > > > > > > > > > > > > > > > BTW: "Apache-2.0 WITH LLVM-exception (5)" should be > > modified/removed in > > > > future? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > > > Kimm King(kimmk...@apache.org/kimmk...@163.com) > > > > > Apache Dubbo PMC Member > > > > > github: kimmking > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > At 2023-02-17 21:12:59, "Willem Jiang" > > wrote: > > > > >>+1, it's an interesting project. I'd like to be a mentor of this > > project. > > > > >>BTW, even though there are 37 contributors, I found Xuanwo did > most > > > > >>of the development, which is not a good bus factor[1] of this > > project. > > > > >>We can make it better during the incubating process. > > > > >> > > > > >>[1]https://en.wikipedia.org/wiki/Bus_factor > > > > >> > > > > >> > > > > >>Willem Jiang > > > > >> > > > > >>Twitter: willemjiang > > > > >>Weibo: 姜宁willem > > > > >> > > > > >>On Fri, Feb 17, 2023 at 7:22 AM tison > wrote: > > > > >>> > > > > >>> Hi IPMC, > > > > >>> > > > > >>> I would like to propose OpenDAL[1] as a new apache incubator > > project, > > > > you > > > > >>> can find the proposal[2] of OpenDAL for more detail. > > > > >>> > > > > >>> [1] https://github.com/datafuselabs/opendal > > > > >>> [2] > > > > > https://cwiki.apache.org/confluence/display/INCUBATOR/OpenDAL+Proposal > > > > >>> > > > > >>> Best, > > > > >>> tison. > > > > >>> > > > > >>> Full text of the proposal below: > > > > >>> > > > > >>> ## Abstract > > > > >>> > > > > >>> OpenDAL means “Open Data Access Layer”. It’s a Rust library that > > helps > > > > >>> developers access data freely, painlessly, and efficiently over > > > > multiple > > > > >>> services, including AWS S3, HDFS, POSIX-compatible file systems, > > and > > > > so on. > > > > >>> > > > > >>> ## Proposal > > > > >>> > > > > >>> OpenDAL provides the following features to support developers > > accessing > > > > >>> data freely, painlessly, and efficiently: > > > > >>> > > > > >>> - Freely > > > > >>> - Access different storage services in the same way > > > > >>> - Behavior tests for all services > > > > >>> - Cross-language/project bindings (working in progress) > > > > >>> - Painlessly > > > > >>> - **100%** of documents covered > > > > >>> - Powerful [Layers]( > > > > >>> https://opendal.databend.rs/opendal/layers/index.html) > > > > >>> - Automatic [retry]( > > > > >>> > https://opendal.databend.rs/opendal/layers/struct.RetryLayer.html) > > > > support > > > > >>> - Full observability support: [logging]( > > > > >>> > > https://opendal.databend.rs/opendal/layers/struct.LoggingLayer.html > > > > >>> ), [tracing]( > > > > >>> > > https://opendal.databend.rs/opendal/layers/struct.TracingLayer.html), > > > > and > > > > >>> [metrics]( > > > > >>> > > https://opendal.databend.rs/opendal/layers/struct.MetricsLayer.html). > > > > >>> - Native chaos testing > > > > >>> - Native service-side encryption support > > > > >>> - Efficiently > > > > >>> - Zero cost: mapping to underlying API calls directly > > > > >>> - Best effort: auto-pick the best `read`/`seek`/`next` > > > > implementations > > > > >>> based on services > > > > >>> - [Auto metadata reuse]( > > > > >>> https://opendal.databend.rs/rfcs/0561-list-metadata-reuse.html): > > avoid > > > > >>> extra `metadata` calls > > > > >>> > > > > >>> OpenDAL was originally designed to be used by the Databend > project > > but > > > > is > > > > >>> now being used by Mozilla's sccache, DeepETH's mars, and several > > > > database > > > > >>> startups. > > > > >>> > > > > >>> We believe that the OpenDAL project will provide diversity value > > to the > > > > >>> community if OpenDAL is
Re: [DISCUSS] Incubating Proposal for OpenDAL
It is good to see you make the preparation ready so quickly. Hope you woenjobe benefit of joining the ASF for.building a more diverse and bigger community. hulk 于2023年2月19日 周日16:42写道： > +1, good luck. > > On Sun, 19 Feb 2023 at 10:18, tison wrote: > > > > @Xuanwo: Updated. > > > > Best, > > tison. > > > > > > Xuanwo 于2023年2月19日周日 08:54写道： > > > > > @Kimm King, thanks for pointing this out! > > > > > > I did a double check on all the deps marked as Apache 2.0 with the LLVM > > > exception. The result is that io-lifetimes,linux-raw-sys,rustix,wasi > are > > > all triple-licensed under Apache 2.0 with the LLVM Exception, Apache > 2.0 > > > and MIT terms. I think they should be OK to use them as Apache 2.0. > > > > > > @tison, can you help update the proposal to change all deps under > Apache > > > 2.0 with the LLVM exception to Apache 2.0? > > > > > > On Sun, Feb 19, 2023, at 00:17, KimmKing wrote: > > > > +1, it is a "delicious" project. > > > > > > > > > > > > BTW: "Apache-2.0 WITH LLVM-exception (5)" should be > modified/removed in > > > future? > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > Kimm King(kimmk...@apache.org/kimmk...@163.com) > > > > Apache Dubbo PMC Member > > > > github: kimmking > > > > > > > > > > > > > > > > > > > > > > > > At 2023-02-17 21:12:59, "Willem Jiang" > wrote: > > > >>+1, it's an interesting project. I'd like to be a mentor of this > project. > > > >>BTW, even though there are 37 contributors, I found Xuanwo did most > > > >>of the development, which is not a good bus factor[1] of this > project. > > > >>We can make it better during the incubating process. > > > >> > > > >>[1]https://en.wikipedia.org/wiki/Bus_factor > > > >> > > > >> > > > >>Willem Jiang > > > >> > > > >>Twitter: willemjiang > > > >>Weibo: 姜宁willem > > > >> > > > >>On Fri, Feb 17, 2023 at 7:22 AM tison wrote: > > > >>> > > > >>> Hi IPMC, > > > >>> > > > >>> I would like to propose OpenDAL[1] as a new apache incubator > project, > > > you > > > >>> can find the proposal[2] of OpenDAL for more detail. > > > >>> > > > >>> [1] https://github.com/datafuselabs/opendal > > > >>> [2] > > > https://cwiki.apache.org/confluence/display/INCUBATOR/OpenDAL+Proposal > > > >>> > > > >>> Best, > > > >>> tison. > > > >>> > > > >>> Full text of the proposal below: > > > >>> > > > >>> ## Abstract > > > >>> > > > >>> OpenDAL means “Open Data Access Layer”. It’s a Rust library that > helps > > > >>> developers access data freely, painlessly, and efficiently over > > > multiple > > > >>> services, including AWS S3, HDFS, POSIX-compatible file systems, > and > > > so on. > > > >>> > > > >>> ## Proposal > > > >>> > > > >>> OpenDAL provides the following features to support developers > accessing > > > >>> data freely, painlessly, and efficiently: > > > >>> > > > >>> - Freely > > > >>> - Access different storage services in the same way > > > >>> - Behavior tests for all services > > > >>> - Cross-language/project bindings (working in progress) > > > >>> - Painlessly > > > >>> - **100%** of documents covered > > > >>> - Powerful [Layers]( > > > >>> https://opendal.databend.rs/opendal/layers/index.html) > > > >>> - Automatic [retry]( > > > >>> https://opendal.databend.rs/opendal/layers/struct.RetryLayer.html) > > > support > > > >>> - Full observability support: [logging]( > > > >>> > https://opendal.databend.rs/opendal/layers/struct.LoggingLayer.html > > > >>> ), [tracing]( > > > >>> > https://opendal.databend.rs/opendal/layers/struct.TracingLayer.html), > > > and > > > >>> [metrics]( > > > >>> > https://opendal.databend.rs/opendal/layers/struct.MetricsLayer.html). > > > >>> - Native chaos testing > > > >>> - Native service-side encryption support > > > >>> - Efficiently > > > >>> - Zero cost: mapping to underlying API calls directly > > > >>> - Best effort: auto-pick the best `read`/`seek`/`next` > > > implementations > > > >>> based on services > > > >>> - [Auto metadata reuse]( > > > >>> https://opendal.databend.rs/rfcs/0561-list-metadata-reuse.html): > avoid > > > >>> extra `metadata` calls > > > >>> > > > >>> OpenDAL was originally designed to be used by the Databend project > but > > > is > > > >>> now being used by Mozilla's sccache, DeepETH's mars, and several > > > database > > > >>> startups. > > > >>> > > > >>> We believe that the OpenDAL project will provide diversity value > to the > > > >>> community if OpenDAL is brought into the Apache incubator. > > > >>> > > > >>> ## Background > > > >>> > > > >>> OpenDAL is being developed by an open-source community from day one > > > and is > > > >>> owned by DatafuseLabs. The project has been launched in February > 2022. > > > >>> > > > >>> ## Rationale > > > >>> > > > >>> OpenDAL provides a unified storage abstraction layer that > simplifies > > > the > > > >>> interfacing of different storage services. In addition, OpenDAL > > > provides > > > >>> further advanced storage encapsulation, enabling
Re: [DISCUSS] Incubating Proposal for OpenDAL
+1, good luck. On Sun, 19 Feb 2023 at 10:18, tison wrote: > > @Xuanwo: Updated. > > Best, > tison. > > > Xuanwo 于2023年2月19日周日 08:54写道： > > > @Kimm King, thanks for pointing this out! > > > > I did a double check on all the deps marked as Apache 2.0 with the LLVM > > exception. The result is that io-lifetimes,linux-raw-sys,rustix,wasi are > > all triple-licensed under Apache 2.0 with the LLVM Exception, Apache 2.0 > > and MIT terms. I think they should be OK to use them as Apache 2.0. > > > > @tison, can you help update the proposal to change all deps under Apache > > 2.0 with the LLVM exception to Apache 2.0? > > > > On Sun, Feb 19, 2023, at 00:17, KimmKing wrote: > > > +1, it is a "delicious" project. > > > > > > > > > BTW: "Apache-2.0 WITH LLVM-exception (5)" should be modified/removed in > > future? > > > > > > > > > > > > > > > > > > > > > -- > > > > > > Kimm King(kimmk...@apache.org/kimmk...@163.com) > > > Apache Dubbo PMC Member > > > github: kimmking > > > > > > > > > > > > > > > > > > At 2023-02-17 21:12:59, "Willem Jiang" wrote: > > >>+1, it's an interesting project. I'd like to be a mentor of this project. > > >>BTW, even though there are 37 contributors, I found Xuanwo did most > > >>of the development, which is not a good bus factor[1] of this project. > > >>We can make it better during the incubating process. > > >> > > >>[1]https://en.wikipedia.org/wiki/Bus_factor > > >> > > >> > > >>Willem Jiang > > >> > > >>Twitter: willemjiang > > >>Weibo: 姜宁willem > > >> > > >>On Fri, Feb 17, 2023 at 7:22 AM tison wrote: > > >>> > > >>> Hi IPMC, > > >>> > > >>> I would like to propose OpenDAL[1] as a new apache incubator project, > > you > > >>> can find the proposal[2] of OpenDAL for more detail. > > >>> > > >>> [1] https://github.com/datafuselabs/opendal > > >>> [2] > > https://cwiki.apache.org/confluence/display/INCUBATOR/OpenDAL+Proposal > > >>> > > >>> Best, > > >>> tison. > > >>> > > >>> Full text of the proposal below: > > >>> > > >>> ## Abstract > > >>> > > >>> OpenDAL means “Open Data Access Layer”. It’s a Rust library that helps > > >>> developers access data freely, painlessly, and efficiently over > > multiple > > >>> services, including AWS S3, HDFS, POSIX-compatible file systems, and > > so on. > > >>> > > >>> ## Proposal > > >>> > > >>> OpenDAL provides the following features to support developers accessing > > >>> data freely, painlessly, and efficiently: > > >>> > > >>> - Freely > > >>> - Access different storage services in the same way > > >>> - Behavior tests for all services > > >>> - Cross-language/project bindings (working in progress) > > >>> - Painlessly > > >>> - **100%** of documents covered > > >>> - Powerful [Layers]( > > >>> https://opendal.databend.rs/opendal/layers/index.html) > > >>> - Automatic [retry]( > > >>> https://opendal.databend.rs/opendal/layers/struct.RetryLayer.html) > > support > > >>> - Full observability support: [logging]( > > >>> https://opendal.databend.rs/opendal/layers/struct.LoggingLayer.html > > >>> ), [tracing]( > > >>> https://opendal.databend.rs/opendal/layers/struct.TracingLayer.html), > > and > > >>> [metrics]( > > >>> https://opendal.databend.rs/opendal/layers/struct.MetricsLayer.html). > > >>> - Native chaos testing > > >>> - Native service-side encryption support > > >>> - Efficiently > > >>> - Zero cost: mapping to underlying API calls directly > > >>> - Best effort: auto-pick the best `read`/`seek`/`next` > > implementations > > >>> based on services > > >>> - [Auto metadata reuse]( > > >>> https://opendal.databend.rs/rfcs/0561-list-metadata-reuse.html): avoid > > >>> extra `metadata` calls > > >>> > > >>> OpenDAL was originally designed to be used by the Databend project but > > is > > >>> now being used by Mozilla's sccache, DeepETH's mars, and several > > database > > >>> startups. > > >>> > > >>> We believe that the OpenDAL project will provide diversity value to the > > >>> community if OpenDAL is brought into the Apache incubator. > > >>> > > >>> ## Background > > >>> > > >>> OpenDAL is being developed by an open-source community from day one > > and is > > >>> owned by DatafuseLabs. The project has been launched in February 2022. > > >>> > > >>> ## Rationale > > >>> > > >>> OpenDAL provides a unified storage abstraction layer that simplifies > > the > > >>> interfacing of different storage services. In addition, OpenDAL > > provides > > >>> further advanced storage encapsulation, enabling enhancements such as > > >>> automatic retry, request optimization, and observability. OpenDAL > > makes it > > >>> possible to develop once and run on any storage service. > > >>> > > >>> ## Initial Goals > > >>> > > >>> By transferring ownership of the project to the ASF, OpenDAL expects to > > >>> ensure its neutrality and further encourage and facilitate the > > adoption of > > >>> OpenDAL by the community. > > >>> > > >>> Some of the areas we would like to focus on during the Apache > >
Re: [DISCUSS] Incubating Proposal for OpenDAL
@Xuanwo: Updated. Best, tison. Xuanwo 于2023年2月19日周日 08:54写道： > @Kimm King, thanks for pointing this out! > > I did a double check on all the deps marked as Apache 2.0 with the LLVM > exception. The result is that io-lifetimes,linux-raw-sys,rustix,wasi are > all triple-licensed under Apache 2.0 with the LLVM Exception, Apache 2.0 > and MIT terms. I think they should be OK to use them as Apache 2.0. > > @tison, can you help update the proposal to change all deps under Apache > 2.0 with the LLVM exception to Apache 2.0? > > On Sun, Feb 19, 2023, at 00:17, KimmKing wrote: > > +1, it is a "delicious" project. > > > > > > BTW: "Apache-2.0 WITH LLVM-exception (5)" should be modified/removed in > future? > > > > > > > > > > > > > > -- > > > > Kimm King(kimmk...@apache.org/kimmk...@163.com) > > Apache Dubbo PMC Member > > github: kimmking > > > > > > > > > > > > At 2023-02-17 21:12:59, "Willem Jiang" wrote: > >>+1, it's an interesting project. I'd like to be a mentor of this project. > >>BTW, even though there are 37 contributors, I found Xuanwo did most > >>of the development, which is not a good bus factor[1] of this project. > >>We can make it better during the incubating process. > >> > >>[1]https://en.wikipedia.org/wiki/Bus_factor > >> > >> > >>Willem Jiang > >> > >>Twitter: willemjiang > >>Weibo: 姜宁willem > >> > >>On Fri, Feb 17, 2023 at 7:22 AM tison wrote: > >>> > >>> Hi IPMC, > >>> > >>> I would like to propose OpenDAL[1] as a new apache incubator project, > you > >>> can find the proposal[2] of OpenDAL for more detail. > >>> > >>> [1] https://github.com/datafuselabs/opendal > >>> [2] > https://cwiki.apache.org/confluence/display/INCUBATOR/OpenDAL+Proposal > >>> > >>> Best, > >>> tison. > >>> > >>> Full text of the proposal below: > >>> > >>> ## Abstract > >>> > >>> OpenDAL means “Open Data Access Layer”. It’s a Rust library that helps > >>> developers access data freely, painlessly, and efficiently over > multiple > >>> services, including AWS S3, HDFS, POSIX-compatible file systems, and > so on. > >>> > >>> ## Proposal > >>> > >>> OpenDAL provides the following features to support developers accessing > >>> data freely, painlessly, and efficiently: > >>> > >>> - Freely > >>> - Access different storage services in the same way > >>> - Behavior tests for all services > >>> - Cross-language/project bindings (working in progress) > >>> - Painlessly > >>> - **100%** of documents covered > >>> - Powerful [Layers]( > >>> https://opendal.databend.rs/opendal/layers/index.html) > >>> - Automatic [retry]( > >>> https://opendal.databend.rs/opendal/layers/struct.RetryLayer.html) > support > >>> - Full observability support: [logging]( > >>> https://opendal.databend.rs/opendal/layers/struct.LoggingLayer.html > >>> ), [tracing]( > >>> https://opendal.databend.rs/opendal/layers/struct.TracingLayer.html), > and > >>> [metrics]( > >>> https://opendal.databend.rs/opendal/layers/struct.MetricsLayer.html). > >>> - Native chaos testing > >>> - Native service-side encryption support > >>> - Efficiently > >>> - Zero cost: mapping to underlying API calls directly > >>> - Best effort: auto-pick the best `read`/`seek`/`next` > implementations > >>> based on services > >>> - [Auto metadata reuse]( > >>> https://opendal.databend.rs/rfcs/0561-list-metadata-reuse.html): avoid > >>> extra `metadata` calls > >>> > >>> OpenDAL was originally designed to be used by the Databend project but > is > >>> now being used by Mozilla's sccache, DeepETH's mars, and several > database > >>> startups. > >>> > >>> We believe that the OpenDAL project will provide diversity value to the > >>> community if OpenDAL is brought into the Apache incubator. > >>> > >>> ## Background > >>> > >>> OpenDAL is being developed by an open-source community from day one > and is > >>> owned by DatafuseLabs. The project has been launched in February 2022. > >>> > >>> ## Rationale > >>> > >>> OpenDAL provides a unified storage abstraction layer that simplifies > the > >>> interfacing of different storage services. In addition, OpenDAL > provides > >>> further advanced storage encapsulation, enabling enhancements such as > >>> automatic retry, request optimization, and observability. OpenDAL > makes it > >>> possible to develop once and run on any storage service. > >>> > >>> ## Initial Goals > >>> > >>> By transferring ownership of the project to the ASF, OpenDAL expects to > >>> ensure its neutrality and further encourage and facilitate the > adoption of > >>> OpenDAL by the community. > >>> > >>> Some of the areas we would like to focus on during the Apache > incubation > >>> phase include: > >>> > >>> - A healthier community: more maintainers and contributors will be > able to > >>> participate in OpenDAL and own different modules. > >>> - Wider adoption: OpenDAL can be adopted by more open source/commercial > >>> projects, which in turn drives its own functionality. > >>> - Richer integration: OpenDAL enables
Re: [DISCUSS] Incubating Proposal for OpenDAL
@Kimm King, thanks for pointing this out! I did a double check on all the deps marked as Apache 2.0 with the LLVM exception. The result is that io-lifetimes,linux-raw-sys,rustix,wasi are all triple-licensed under Apache 2.0 with the LLVM Exception, Apache 2.0 and MIT terms. I think they should be OK to use them as Apache 2.0. @tison, can you help update the proposal to change all deps under Apache 2.0 with the LLVM exception to Apache 2.0? On Sun, Feb 19, 2023, at 00:17, KimmKing wrote: > +1, it is a "delicious" project. > > > BTW: "Apache-2.0 WITH LLVM-exception (5)" should be modified/removed in > future? > > > > > > > -- > > Kimm King(kimmk...@apache.org/kimmk...@163.com) > Apache Dubbo PMC Member > github: kimmking > > > > > > At 2023-02-17 21:12:59, "Willem Jiang" wrote: >>+1, it's an interesting project. I'd like to be a mentor of this project. >>BTW, even though there are 37 contributors, I found Xuanwo did most >>of the development, which is not a good bus factor[1] of this project. >>We can make it better during the incubating process. >> >>[1]https://en.wikipedia.org/wiki/Bus_factor >> >> >>Willem Jiang >> >>Twitter: willemjiang >>Weibo: 姜宁willem >> >>On Fri, Feb 17, 2023 at 7:22 AM tison wrote: >>> >>> Hi IPMC, >>> >>> I would like to propose OpenDAL[1] as a new apache incubator project, you >>> can find the proposal[2] of OpenDAL for more detail. >>> >>> [1] https://github.com/datafuselabs/opendal >>> [2] https://cwiki.apache.org/confluence/display/INCUBATOR/OpenDAL+Proposal >>> >>> Best, >>> tison. >>> >>> Full text of the proposal below: >>> >>> ## Abstract >>> >>> OpenDAL means “Open Data Access Layer”. It’s a Rust library that helps >>> developers access data freely, painlessly, and efficiently over multiple >>> services, including AWS S3, HDFS, POSIX-compatible file systems, and so on. >>> >>> ## Proposal >>> >>> OpenDAL provides the following features to support developers accessing >>> data freely, painlessly, and efficiently: >>> >>> - Freely >>> - Access different storage services in the same way >>> - Behavior tests for all services >>> - Cross-language/project bindings (working in progress) >>> - Painlessly >>> - **100%** of documents covered >>> - Powerful [Layers]( >>> https://opendal.databend.rs/opendal/layers/index.html) >>> - Automatic [retry]( >>> https://opendal.databend.rs/opendal/layers/struct.RetryLayer.html) support >>> - Full observability support: [logging]( >>> https://opendal.databend.rs/opendal/layers/struct.LoggingLayer.html >>> ), [tracing]( >>> https://opendal.databend.rs/opendal/layers/struct.TracingLayer.html), and >>> [metrics]( >>> https://opendal.databend.rs/opendal/layers/struct.MetricsLayer.html). >>> - Native chaos testing >>> - Native service-side encryption support >>> - Efficiently >>> - Zero cost: mapping to underlying API calls directly >>> - Best effort: auto-pick the best `read`/`seek`/`next` implementations >>> based on services >>> - [Auto metadata reuse]( >>> https://opendal.databend.rs/rfcs/0561-list-metadata-reuse.html): avoid >>> extra `metadata` calls >>> >>> OpenDAL was originally designed to be used by the Databend project but is >>> now being used by Mozilla's sccache, DeepETH's mars, and several database >>> startups. >>> >>> We believe that the OpenDAL project will provide diversity value to the >>> community if OpenDAL is brought into the Apache incubator. >>> >>> ## Background >>> >>> OpenDAL is being developed by an open-source community from day one and is >>> owned by DatafuseLabs. The project has been launched in February 2022. >>> >>> ## Rationale >>> >>> OpenDAL provides a unified storage abstraction layer that simplifies the >>> interfacing of different storage services. In addition, OpenDAL provides >>> further advanced storage encapsulation, enabling enhancements such as >>> automatic retry, request optimization, and observability. OpenDAL makes it >>> possible to develop once and run on any storage service. >>> >>> ## Initial Goals >>> >>> By transferring ownership of the project to the ASF, OpenDAL expects to >>> ensure its neutrality and further encourage and facilitate the adoption of >>> OpenDAL by the community. >>> >>> Some of the areas we would like to focus on during the Apache incubation >>> phase include: >>> >>> - A healthier community: more maintainers and contributors will be able to >>> participate in OpenDAL and own different modules. >>> - Wider adoption: OpenDAL can be adopted by more open source/commercial >>> projects, which in turn drives its own functionality. >>> - Richer integration: OpenDAL enables greater integration of storage >>> services and offers a wider range of language bindings. >>> >>> ## Current Status >>> >>> ### Meritocracy >>> >>> We intend to radically expand the initial developer and user community by >>> running the project the 'Apache way'. Users and new contributors will be >>> respected and welcomed. They will earn credit
Re: Re: [DISCUSS] Incubating Proposal for OpenDAL
Looks like a strong candidate. I would echo Willem's point about needing less reliance on 1 committer. On Sat 18 Feb 2023, 17:18 KimmKing, wrote: > +1, it is a "delicious" project. > > > BTW: "Apache-2.0 WITH LLVM-exception (5)" should be modified/removed in > future? > > > > > > > -- > > Kimm King(kimmk...@apache.org/kimmk...@163.com) > Apache Dubbo PMC Member > github: kimmking > > > > > > At 2023-02-17 21:12:59, "Willem Jiang" wrote: > >+1, it's an interesting project. I'd like to be a mentor of this project. > >BTW, even though there are 37 contributors, I found Xuanwo did most > >of the development, which is not a good bus factor[1] of this project. > >We can make it better during the incubating process. > > > >[1]https://en.wikipedia.org/wiki/Bus_factor > > > > > >Willem Jiang > > > >Twitter: willemjiang > >Weibo: 姜宁willem > > > >On Fri, Feb 17, 2023 at 7:22 AM tison wrote: > >> > >> Hi IPMC, > >> > >> I would like to propose OpenDAL[1] as a new apache incubator project, > you > >> can find the proposal[2] of OpenDAL for more detail. > >> > >> [1] https://github.com/datafuselabs/opendal > >> [2] > https://cwiki.apache.org/confluence/display/INCUBATOR/OpenDAL+Proposal > >> > >> Best, > >> tison. > >> > >> Full text of the proposal below: > >> > >> ## Abstract > >> > >> OpenDAL means “Open Data Access Layer”. It’s a Rust library that helps > >> developers access data freely, painlessly, and efficiently over multiple > >> services, including AWS S3, HDFS, POSIX-compatible file systems, and so > on. > >> > >> ## Proposal > >> > >> OpenDAL provides the following features to support developers accessing > >> data freely, painlessly, and efficiently: > >> > >> - Freely > >> - Access different storage services in the same way > >> - Behavior tests for all services > >> - Cross-language/project bindings (working in progress) > >> - Painlessly > >> - **100%** of documents covered > >> - Powerful [Layers]( > >> https://opendal.databend.rs/opendal/layers/index.html) > >> - Automatic [retry]( > >> https://opendal.databend.rs/opendal/layers/struct.RetryLayer.html) > support > >> - Full observability support: [logging]( > >> https://opendal.databend.rs/opendal/layers/struct.LoggingLayer.html > >> ), [tracing]( > >> https://opendal.databend.rs/opendal/layers/struct.TracingLayer.html), > and > >> [metrics]( > >> https://opendal.databend.rs/opendal/layers/struct.MetricsLayer.html). > >> - Native chaos testing > >> - Native service-side encryption support > >> - Efficiently > >> - Zero cost: mapping to underlying API calls directly > >> - Best effort: auto-pick the best `read`/`seek`/`next` > implementations > >> based on services > >> - [Auto metadata reuse]( > >> https://opendal.databend.rs/rfcs/0561-list-metadata-reuse.html): avoid > >> extra `metadata` calls > >> > >> OpenDAL was originally designed to be used by the Databend project but > is > >> now being used by Mozilla's sccache, DeepETH's mars, and several > database > >> startups. > >> > >> We believe that the OpenDAL project will provide diversity value to the > >> community if OpenDAL is brought into the Apache incubator. > >> > >> ## Background > >> > >> OpenDAL is being developed by an open-source community from day one and > is > >> owned by DatafuseLabs. The project has been launched in February 2022. > >> > >> ## Rationale > >> > >> OpenDAL provides a unified storage abstraction layer that simplifies the > >> interfacing of different storage services. In addition, OpenDAL provides > >> further advanced storage encapsulation, enabling enhancements such as > >> automatic retry, request optimization, and observability. OpenDAL makes > it > >> possible to develop once and run on any storage service. > >> > >> ## Initial Goals > >> > >> By transferring ownership of the project to the ASF, OpenDAL expects to > >> ensure its neutrality and further encourage and facilitate the adoption > of > >> OpenDAL by the community. > >> > >> Some of the areas we would like to focus on during the Apache incubation > >> phase include: > >> > >> - A healthier community: more maintainers and contributors will be able > to > >> participate in OpenDAL and own different modules. > >> - Wider adoption: OpenDAL can be adopted by more open source/commercial > >> projects, which in turn drives its own functionality. > >> - Richer integration: OpenDAL enables greater integration of storage > >> services and offers a wider range of language bindings. > >> > >> ## Current Status > >> > >> ### Meritocracy > >> > >> We intend to radically expand the initial developer and user community > by > >> running the project the 'Apache way'. Users and new contributors will be > >> respected and welcomed. They will earn credit by participating in the > >> community and providing quality patches/support to move the project > >> forward. They will also be encouraged to provide non-code contributions > >> (documentation, events, community
Re: [DISCUSS] Incubating Proposal for OpenDAL
Thanks for your feedbacks! @Willem Thanks for your reply. I've added you to the mentor list. AFAIK an incubating project needs up to 5 mentors :) For the bus factor concern, I agree that it's an issue that to be resolved during the incubating process. As OpenDAL attracts more and more adoptions in the Rust ecosystem, I'm not quite concern about it. Best, tison. Willem Jiang 于2023年2月17日周五 21:13写道： > +1, it's an interesting project. I'd like to be a mentor of this project. > BTW, even though there are 37 contributors, I found Xuanwo did most > of the development, which is not a good bus factor[1] of this project. > We can make it better during the incubating process. > > [1]https://en.wikipedia.org/wiki/Bus_factor > > > Willem Jiang > > Twitter: willemjiang > Weibo: 姜宁willem > > On Fri, Feb 17, 2023 at 7:22 AM tison wrote: > > > > Hi IPMC, > > > > I would like to propose OpenDAL[1] as a new apache incubator project, you > > can find the proposal[2] of OpenDAL for more detail. > > > > [1] https://github.com/datafuselabs/opendal > > [2] > https://cwiki.apache.org/confluence/display/INCUBATOR/OpenDAL+Proposal > > > > Best, > > tison. > > > > Full text of the proposal below: > > > > ## Abstract > > > > OpenDAL means “Open Data Access Layer”. It’s a Rust library that helps > > developers access data freely, painlessly, and efficiently over multiple > > services, including AWS S3, HDFS, POSIX-compatible file systems, and so > on. > > > > ## Proposal > > > > OpenDAL provides the following features to support developers accessing > > data freely, painlessly, and efficiently: > > > > - Freely > > - Access different storage services in the same way > > - Behavior tests for all services > > - Cross-language/project bindings (working in progress) > > - Painlessly > > - **100%** of documents covered > > - Powerful [Layers]( > > https://opendal.databend.rs/opendal/layers/index.html) > > - Automatic [retry]( > > https://opendal.databend.rs/opendal/layers/struct.RetryLayer.html) > support > > - Full observability support: [logging]( > > https://opendal.databend.rs/opendal/layers/struct.LoggingLayer.html > > ), [tracing]( > > https://opendal.databend.rs/opendal/layers/struct.TracingLayer.html), > and > > [metrics]( > > https://opendal.databend.rs/opendal/layers/struct.MetricsLayer.html). > > - Native chaos testing > > - Native service-side encryption support > > - Efficiently > > - Zero cost: mapping to underlying API calls directly > > - Best effort: auto-pick the best `read`/`seek`/`next` > implementations > > based on services > > - [Auto metadata reuse]( > > https://opendal.databend.rs/rfcs/0561-list-metadata-reuse.html): avoid > > extra `metadata` calls > > > > OpenDAL was originally designed to be used by the Databend project but is > > now being used by Mozilla's sccache, DeepETH's mars, and several database > > startups. > > > > We believe that the OpenDAL project will provide diversity value to the > > community if OpenDAL is brought into the Apache incubator. > > > > ## Background > > > > OpenDAL is being developed by an open-source community from day one and > is > > owned by DatafuseLabs. The project has been launched in February 2022. > > > > ## Rationale > > > > OpenDAL provides a unified storage abstraction layer that simplifies the > > interfacing of different storage services. In addition, OpenDAL provides > > further advanced storage encapsulation, enabling enhancements such as > > automatic retry, request optimization, and observability. OpenDAL makes > it > > possible to develop once and run on any storage service. > > > > ## Initial Goals > > > > By transferring ownership of the project to the ASF, OpenDAL expects to > > ensure its neutrality and further encourage and facilitate the adoption > of > > OpenDAL by the community. > > > > Some of the areas we would like to focus on during the Apache incubation > > phase include: > > > > - A healthier community: more maintainers and contributors will be able > to > > participate in OpenDAL and own different modules. > > - Wider adoption: OpenDAL can be adopted by more open source/commercial > > projects, which in turn drives its own functionality. > > - Richer integration: OpenDAL enables greater integration of storage > > services and offers a wider range of language bindings. > > > > ## Current Status > > > > ### Meritocracy > > > > We intend to radically expand the initial developer and user community by > > running the project the 'Apache way'. Users and new contributors will be > > respected and welcomed. They will earn credit by participating in the > > community and providing quality patches/support to move the project > > forward. They will also be encouraged to provide non-code contributions > > (documentation, events, community management, etc.) and will be rewarded > > accordingly. Those with a proven track record of support and quality will > > be encouraged to become committers. > > > > ###
Re: [DISCUSS] Incubating Proposal for OpenDAL
+1, it's an interesting project. I'd like to be a mentor of this project. BTW, even though there are 37 contributors, I found Xuanwo did most of the development, which is not a good bus factor[1] of this project. We can make it better during the incubating process. [1]https://en.wikipedia.org/wiki/Bus_factor Willem Jiang Twitter: willemjiang Weibo: 姜宁willem On Fri, Feb 17, 2023 at 7:22 AM tison wrote: > > Hi IPMC, > > I would like to propose OpenDAL[1] as a new apache incubator project, you > can find the proposal[2] of OpenDAL for more detail. > > [1] https://github.com/datafuselabs/opendal > [2] https://cwiki.apache.org/confluence/display/INCUBATOR/OpenDAL+Proposal > > Best, > tison. > > Full text of the proposal below: > > ## Abstract > > OpenDAL means “Open Data Access Layer”. It’s a Rust library that helps > developers access data freely, painlessly, and efficiently over multiple > services, including AWS S3, HDFS, POSIX-compatible file systems, and so on. > > ## Proposal > > OpenDAL provides the following features to support developers accessing > data freely, painlessly, and efficiently: > > - Freely > - Access different storage services in the same way > - Behavior tests for all services > - Cross-language/project bindings (working in progress) > - Painlessly > - **100%** of documents covered > - Powerful [Layers]( > https://opendal.databend.rs/opendal/layers/index.html) > - Automatic [retry]( > https://opendal.databend.rs/opendal/layers/struct.RetryLayer.html) support > - Full observability support: [logging]( > https://opendal.databend.rs/opendal/layers/struct.LoggingLayer.html > ), [tracing]( > https://opendal.databend.rs/opendal/layers/struct.TracingLayer.html), and > [metrics]( > https://opendal.databend.rs/opendal/layers/struct.MetricsLayer.html). > - Native chaos testing > - Native service-side encryption support > - Efficiently > - Zero cost: mapping to underlying API calls directly > - Best effort: auto-pick the best `read`/`seek`/`next` implementations > based on services > - [Auto metadata reuse]( > https://opendal.databend.rs/rfcs/0561-list-metadata-reuse.html): avoid > extra `metadata` calls > > OpenDAL was originally designed to be used by the Databend project but is > now being used by Mozilla's sccache, DeepETH's mars, and several database > startups. > > We believe that the OpenDAL project will provide diversity value to the > community if OpenDAL is brought into the Apache incubator. > > ## Background > > OpenDAL is being developed by an open-source community from day one and is > owned by DatafuseLabs. The project has been launched in February 2022. > > ## Rationale > > OpenDAL provides a unified storage abstraction layer that simplifies the > interfacing of different storage services. In addition, OpenDAL provides > further advanced storage encapsulation, enabling enhancements such as > automatic retry, request optimization, and observability. OpenDAL makes it > possible to develop once and run on any storage service. > > ## Initial Goals > > By transferring ownership of the project to the ASF, OpenDAL expects to > ensure its neutrality and further encourage and facilitate the adoption of > OpenDAL by the community. > > Some of the areas we would like to focus on during the Apache incubation > phase include: > > - A healthier community: more maintainers and contributors will be able to > participate in OpenDAL and own different modules. > - Wider adoption: OpenDAL can be adopted by more open source/commercial > projects, which in turn drives its own functionality. > - Richer integration: OpenDAL enables greater integration of storage > services and offers a wider range of language bindings. > > ## Current Status > > ### Meritocracy > > We intend to radically expand the initial developer and user community by > running the project the 'Apache way'. Users and new contributors will be > respected and welcomed. They will earn credit by participating in the > community and providing quality patches/support to move the project > forward. They will also be encouraged to provide non-code contributions > (documentation, events, community management, etc.) and will be rewarded > accordingly. Those with a proven track record of support and quality will > be encouraged to become committers. > > ### Community > > Contributors: 37 > > Users: > > - Databend: A cloud data warehouse > - GreptimeDB: A time-series database > - Sccache: ccache with cloud storage > - RisingWave: A Distributed SQL Database for Stream Processing > > ### Core Developers > > The core developers are all experienced open-source developers. They have > been running the OpenDAL community for 1 year. > > ### Alignment > > ## Known Risks > > ### Project Name > > We have checked and believe that the name is appropriate and that the > project has legal permission to continue using its current name. There are > no other projects with this name found in a Google search. > >
Re: [DISCUSS] Incubating Proposal for OpenDAL
+1, openDAL is a good name and an interesting project, good luck Best, Huajie Wang Xinyu Zhou 于2023年2月17日周五 16:43写道： > +1 Like the slogan of OpenDAL. > > Storage software is increasingly adopting Rust, OpenDAL hides the > complexity of cloud storage and enables users to leverage the benefits of > cloud storage easily. > > On Fri, Feb 17, 2023 at 7:21 AM tison wrote: > > > Hi IPMC, > > > > I would like to propose OpenDAL[1] as a new apache incubator project, you > > can find the proposal[2] of OpenDAL for more detail. > > > > [1] https://github.com/datafuselabs/opendal > > [2] > https://cwiki.apache.org/confluence/display/INCUBATOR/OpenDAL+Proposal > > > > Best, > > tison. > > > > Full text of the proposal below: > > > > ## Abstract > > > > OpenDAL means “Open Data Access Layer”. It’s a Rust library that helps > > developers access data freely, painlessly, and efficiently over multiple > > services, including AWS S3, HDFS, POSIX-compatible file systems, and so > on. > > > > ## Proposal > > > > OpenDAL provides the following features to support developers accessing > > data freely, painlessly, and efficiently: > > > > - Freely > > - Access different storage services in the same way > > - Behavior tests for all services > > - Cross-language/project bindings (working in progress) > > - Painlessly > > - **100%** of documents covered > > - Powerful [Layers]( > > https://opendal.databend.rs/opendal/layers/index.html) > > - Automatic [retry]( > > https://opendal.databend.rs/opendal/layers/struct.RetryLayer.html) > support > > - Full observability support: [logging]( > > https://opendal.databend.rs/opendal/layers/struct.LoggingLayer.html > > ), [tracing]( > > https://opendal.databend.rs/opendal/layers/struct.TracingLayer.html), > and > > [metrics]( > > https://opendal.databend.rs/opendal/layers/struct.MetricsLayer.html). > > - Native chaos testing > > - Native service-side encryption support > > - Efficiently > > - Zero cost: mapping to underlying API calls directly > > - Best effort: auto-pick the best `read`/`seek`/`next` > implementations > > based on services > > - [Auto metadata reuse]( > > https://opendal.databend.rs/rfcs/0561-list-metadata-reuse.html): avoid > > extra `metadata` calls > > > > OpenDAL was originally designed to be used by the Databend project but is > > now being used by Mozilla's sccache, DeepETH's mars, and several database > > startups. > > > > We believe that the OpenDAL project will provide diversity value to the > > community if OpenDAL is brought into the Apache incubator. > > > > ## Background > > > > OpenDAL is being developed by an open-source community from day one and > is > > owned by DatafuseLabs. The project has been launched in February 2022. > > > > ## Rationale > > > > OpenDAL provides a unified storage abstraction layer that simplifies the > > interfacing of different storage services. In addition, OpenDAL provides > > further advanced storage encapsulation, enabling enhancements such as > > automatic retry, request optimization, and observability. OpenDAL makes > it > > possible to develop once and run on any storage service. > > > > ## Initial Goals > > > > By transferring ownership of the project to the ASF, OpenDAL expects to > > ensure its neutrality and further encourage and facilitate the adoption > of > > OpenDAL by the community. > > > > Some of the areas we would like to focus on during the Apache incubation > > phase include: > > > > - A healthier community: more maintainers and contributors will be able > to > > participate in OpenDAL and own different modules. > > - Wider adoption: OpenDAL can be adopted by more open source/commercial > > projects, which in turn drives its own functionality. > > - Richer integration: OpenDAL enables greater integration of storage > > services and offers a wider range of language bindings. > > > > ## Current Status > > > > ### Meritocracy > > > > We intend to radically expand the initial developer and user community by > > running the project the 'Apache way'. Users and new contributors will be > > respected and welcomed. They will earn credit by participating in the > > community and providing quality patches/support to move the project > > forward. They will also be encouraged to provide non-code contributions > > (documentation, events, community management, etc.) and will be rewarded > > accordingly. Those with a proven track record of support and quality will > > be encouraged to become committers. > > > > ### Community > > > > Contributors: 37 > > > > Users: > > > > - Databend: A cloud data warehouse > > - GreptimeDB: A time-series database > > - Sccache: ccache with cloud storage > > - RisingWave: A Distributed SQL Database for Stream Processing > > > > ### Core Developers > > > > The core developers are all experienced open-source developers. They have > > been running the OpenDAL community for 1 year. > > > > ### Alignment > > > > ## Known Risks > > > > ###
Re: [DISCUSS] Incubating Proposal for OpenDAL
+1 Like the slogan of OpenDAL. Storage software is increasingly adopting Rust, OpenDAL hides the complexity of cloud storage and enables users to leverage the benefits of cloud storage easily. On Fri, Feb 17, 2023 at 7:21 AM tison wrote: > Hi IPMC, > > I would like to propose OpenDAL[1] as a new apache incubator project, you > can find the proposal[2] of OpenDAL for more detail. > > [1] https://github.com/datafuselabs/opendal > [2] https://cwiki.apache.org/confluence/display/INCUBATOR/OpenDAL+Proposal > > Best, > tison. > > Full text of the proposal below: > > ## Abstract > > OpenDAL means “Open Data Access Layer”. It’s a Rust library that helps > developers access data freely, painlessly, and efficiently over multiple > services, including AWS S3, HDFS, POSIX-compatible file systems, and so on. > > ## Proposal > > OpenDAL provides the following features to support developers accessing > data freely, painlessly, and efficiently: > > - Freely > - Access different storage services in the same way > - Behavior tests for all services > - Cross-language/project bindings (working in progress) > - Painlessly > - **100%** of documents covered > - Powerful [Layers]( > https://opendal.databend.rs/opendal/layers/index.html) > - Automatic [retry]( > https://opendal.databend.rs/opendal/layers/struct.RetryLayer.html) support > - Full observability support: [logging]( > https://opendal.databend.rs/opendal/layers/struct.LoggingLayer.html > ), [tracing]( > https://opendal.databend.rs/opendal/layers/struct.TracingLayer.html), and > [metrics]( > https://opendal.databend.rs/opendal/layers/struct.MetricsLayer.html). > - Native chaos testing > - Native service-side encryption support > - Efficiently > - Zero cost: mapping to underlying API calls directly > - Best effort: auto-pick the best `read`/`seek`/`next` implementations > based on services > - [Auto metadata reuse]( > https://opendal.databend.rs/rfcs/0561-list-metadata-reuse.html): avoid > extra `metadata` calls > > OpenDAL was originally designed to be used by the Databend project but is > now being used by Mozilla's sccache, DeepETH's mars, and several database > startups. > > We believe that the OpenDAL project will provide diversity value to the > community if OpenDAL is brought into the Apache incubator. > > ## Background > > OpenDAL is being developed by an open-source community from day one and is > owned by DatafuseLabs. The project has been launched in February 2022. > > ## Rationale > > OpenDAL provides a unified storage abstraction layer that simplifies the > interfacing of different storage services. In addition, OpenDAL provides > further advanced storage encapsulation, enabling enhancements such as > automatic retry, request optimization, and observability. OpenDAL makes it > possible to develop once and run on any storage service. > > ## Initial Goals > > By transferring ownership of the project to the ASF, OpenDAL expects to > ensure its neutrality and further encourage and facilitate the adoption of > OpenDAL by the community. > > Some of the areas we would like to focus on during the Apache incubation > phase include: > > - A healthier community: more maintainers and contributors will be able to > participate in OpenDAL and own different modules. > - Wider adoption: OpenDAL can be adopted by more open source/commercial > projects, which in turn drives its own functionality. > - Richer integration: OpenDAL enables greater integration of storage > services and offers a wider range of language bindings. > > ## Current Status > > ### Meritocracy > > We intend to radically expand the initial developer and user community by > running the project the 'Apache way'. Users and new contributors will be > respected and welcomed. They will earn credit by participating in the > community and providing quality patches/support to move the project > forward. They will also be encouraged to provide non-code contributions > (documentation, events, community management, etc.) and will be rewarded > accordingly. Those with a proven track record of support and quality will > be encouraged to become committers. > > ### Community > > Contributors: 37 > > Users: > > - Databend: A cloud data warehouse > - GreptimeDB: A time-series database > - Sccache: ccache with cloud storage > - RisingWave: A Distributed SQL Database for Stream Processing > > ### Core Developers > > The core developers are all experienced open-source developers. They have > been running the OpenDAL community for 1 year. > > ### Alignment > > ## Known Risks > > ### Project Name > > We have checked and believe that the name is appropriate and that the > project has legal permission to continue using its current name. There are > no other projects with this name found in a Google search. > > ### Orphan Products > > ### Inexperience with Open Source > > OpenDAL's core developers are all experienced open source contributors, and > its main maintainer Xuanwo has
