COOL proposal
Dear Apache Incubator Community, We propose to contribute COOL as an Apache Incubator project. COOL is a cohort OLAP system specialized for cohort analysis with extremely low latency. The vision of COOL is to address the inefficiency of underlying database systems processing cohort analysis (cohort queries) which is an emerging and widely-used analysis pattern in various areas. By utilizing COOL, we can process complicated cohort queries with flexible definitions of cohorts and events in near real-time response time. We need Champions and Mentors, to help guide us on the development of this project. Please feel free to contact our team if any of you are interested. Thanks a lot. Best Regards, Team of COOL # COOL proposal ## Abstract COOL is an online cohort analytical processing system specialized for cohort analysis with extremely low latency. ## Proposal The vision of COOL is to address the inefficiency of underlying database systems processing cohort analysis (cohort queries) which is an emerging and widely-used analysis pattern in various areas. In COOL, cohort query processing is facilitated by specialized operators that involve only two fast scans on sophisticated storage to achieve real-time responses. COOL has been designed to provide user-friendly querying primitives to address the pain point of writing complex and lengthy queries for cohort analysis using SQL-like languages. Specifically, at least five SQL queries are needed for a conventional OLAP database system to perform cohort analysis in a non-intrusive manner. We submit this proposal to donate the COOL system, its related code, and artifacts (documentation, website application, wiki, etc) to Apache Software Foundation Incubator. We are confident that COOL will further promote the diversity of the Apache community and the Apache is able to provide COOL with a better environment to build its community, making it a useful and efficient tool for large-scale cohort analysis. ##Background Cohort analysis (https://en.wikipedia.org/wiki/Cohort_analysis for quick reference) is a method of analyzing metrics across different groups (i.e., cohorts), which share common characteristics in the accumulated data. These characteristics play a critical role in user profiling and the decision-making process in data-driven organizations. For example, cohort analysis is useful in customer retention analysis and the effectiveness of a promotional event. Observing the growth of users alongside running the user acquisition, or observing player progression in online gaming, we can evaluate how different groups of players evolve as time progresses. The efficiency of cohort query processing is vital in such a scenario as analysts may have to work out strategies promptly for the online service. Another example of cohort analysis could be a side-effect evaluation of a clinical trial, in which the clinicians want to monitor and determine the effectiveness of new medicines among different patient groups. Unlike the analysts for online services, the clinicians can wait for a much longer duration (over months or even years) to study the effectiveness of treatments, etc. However, it is difficult for any clinician to construct complex cohort queries (using SQL) to conduct cohort analysis. With the target of providing near real-time cohort analysis responses, COOL was initiated as a research project around 2016. It has been used for various real-world applications, such as sales of online game gadgets/equipment, and sales of virtual assets and gears in online games. The COOL system has been designed as a very efficient cohort analytical processing system with a fast response time and flexible definition of cohorts and events. It is at least one order of magnitude faster than cohort processing using a conventional database engine. For ease of use, COOL accepts a single self-defined query in JSON format, rather than multiple complex SQL statements. ##Rationale There is a strong need to support cohort analysis efficiently and effectively with the society evolving and COOL meets such need greatly. The querying response of cohort analysis in COOL is real-time, which is at least one order of magnitude compared to traditional OLAP systems. Meanwhile, COOL accepts a single self-defined query in JSON format, rather than multiple complex SQL statements. Besides, COOL can also integrate data from different data sources. ##Initial Goals The initial goal is to move the existing codebase to Apache Software Foundation and improve it with the standard Apache development process. We plan for incremental development in the following directions: more storage connectors, more file format parsers, a feasible caching mechanism, and utilizing COOL's cohort results to facilitate building machine learning models. All these will be released in stages with the community following the Apache process.
Re: [VOTE] Release Apache Linkis (Incubating) 1.1.0-RC2
+1 (binding) I checked: - Download links are valid. - LICENSE and NOTICE files are correct. - Apache rat checks are OK. - I can compile from source. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC, Apache Incubator PMC, Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr...@kylin.apache.org 俊平堵 于2022年4月8日周五 22:18写道： > +1 (binding) > > I checked: > [OK] Download links are valid. > [OK] Linkis Community Voting Thread is valid. > [OK] LICENSE and NOTICE files are correct. > [OK] DISCLAIMER-WIP file exists. > [OK] Apache rat checks are OK. > [OK] can compile from source. > > li gang 于2022年4月8日 周五下午7:49写道： > > > +1 (non-binding) > > > > I checked > > [OK] LICENSE and NOTICE files exist > > [OK] Include the word incubating in the release file name. > > [OK] DISCLAIMER-WIP file exists > > [OK] Signatures and hashes are fine > > [OK] Apache rat checks are OK > > [OK] Can compile from source. > > > > wangxiaogang 于2022年4月4日周一 17:34写道： > > > > > Hello Incubator Community, > > > > > > This is a call for vote to release Apache Linkis (Incubating) version > > > Release-1.1.0-RC2. > > > > > > The Apache Linkis community has voted on and approved a proposal to > > > release Apache Linkis(Incubating) version 1.1.0-RC2. We now kindly > > > request the Incubator PMC members review and vote on this incubator > > > release. > > > > > > Apache Linkis builds a computation middleware layer to decouple the > > > upper applications and the underlying data engines, provides > > > standardized interfaces (REST, JDBC, WebSocket etc.) to easily connect > > > to various underlying engines (Spark, Presto, Flink, etc.), while > > > enables cross engine context sharing, unified job & engine governance > > > and orchestration. > > > > > > Linkis community vote thread: > > > https://lists.apache.org/thread/vjqbyhdqtvqdy30s08rwo514s9dyts4w > > > > > > Linkis community vote result thread: > > > https://lists.apache.org/thread/97bdsv4s55kbbvgwvlck1xskm57xkt42 > > > > > > The release candidates: > > > https://dist.apache.org/repos/dist/dev/incubator/linkis/1.1.0-RC2/ > > > > > > Git tag for the release: > > > > > > https://github.com/apache/incubator-linkis/releases/tag/release-1.1.0-rc2 > > > > > > Release notes: > https://linkis.apache.org/docs/1.1.0/release-notes-1.1.0/ > > > > > > The artifacts signed with PGP key [6F179FBD], corresponding to [ > > > wangxiaog...@apache.org], that can be found in keys file: > > > https://downloads.apache.org/incubator/linkis/KEYS > > > > > > As the DISCLAIMER-WIP shows, this release still left some license > > > problems, which will be gradually resolved during incubation. > > > > > > The vote will be open for at least 72 hours or until the necessary > number > > > of votes are reached. > > > > > > Please vote accordingly: > > > [ ] +1 approve > > > [ ] +0 no opinion > > > [ ] -1 disapprove with the reason > > > > > > More detail checklist please refer: > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist > > > > > > Steps to validate the release，Please refer to: > > > https://linkis.apache.org/community/how-to-verify > > > > > > Thanks, > > > On behalf of Apache Linkis(Incubating) community. > > > > > > - > > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > > > For additional commands, e-mail: general-h...@incubator.apache.org > > > > > > > > > > -- > > > > > > -- > > Best Regards > > > > DolphinScheduler PMC > > Gang Li 李岗 > > > > lgcar...@apache.org > > >
Re: [VOTE] Release Apache Linkis (Incubating) 1.1.0-RC2
+1 (binding) I checked: [OK] Download links are valid. [OK] Linkis Community Voting Thread is valid. [OK] LICENSE and NOTICE files are correct. [OK] DISCLAIMER-WIP file exists. [OK] Apache rat checks are OK. [OK] can compile from source. li gang 于2022年4月8日 周五下午7:49写道： > +1 (non-binding) > > I checked > [OK] LICENSE and NOTICE files exist > [OK] Include the word incubating in the release file name. > [OK] DISCLAIMER-WIP file exists > [OK] Signatures and hashes are fine > [OK] Apache rat checks are OK > [OK] Can compile from source. > > wangxiaogang 于2022年4月4日周一 17:34写道： > > > Hello Incubator Community, > > > > This is a call for vote to release Apache Linkis (Incubating) version > > Release-1.1.0-RC2. > > > > The Apache Linkis community has voted on and approved a proposal to > > release Apache Linkis(Incubating) version 1.1.0-RC2. We now kindly > > request the Incubator PMC members review and vote on this incubator > > release. > > > > Apache Linkis builds a computation middleware layer to decouple the > > upper applications and the underlying data engines, provides > > standardized interfaces (REST, JDBC, WebSocket etc.) to easily connect > > to various underlying engines (Spark, Presto, Flink, etc.), while > > enables cross engine context sharing, unified job & engine governance > > and orchestration. > > > > Linkis community vote thread: > > https://lists.apache.org/thread/vjqbyhdqtvqdy30s08rwo514s9dyts4w > > > > Linkis community vote result thread: > > https://lists.apache.org/thread/97bdsv4s55kbbvgwvlck1xskm57xkt42 > > > > The release candidates: > > https://dist.apache.org/repos/dist/dev/incubator/linkis/1.1.0-RC2/ > > > > Git tag for the release: > > > https://github.com/apache/incubator-linkis/releases/tag/release-1.1.0-rc2 > > > > Release notes: https://linkis.apache.org/docs/1.1.0/release-notes-1.1.0/ > > > > The artifacts signed with PGP key [6F179FBD], corresponding to [ > > wangxiaog...@apache.org], that can be found in keys file: > > https://downloads.apache.org/incubator/linkis/KEYS > > > > As the DISCLAIMER-WIP shows, this release still left some license > > problems, which will be gradually resolved during incubation. > > > > The vote will be open for at least 72 hours or until the necessary number > > of votes are reached. > > > > Please vote accordingly: > > [ ] +1 approve > > [ ] +0 no opinion > > [ ] -1 disapprove with the reason > > > > More detail checklist please refer: > > > > > > > https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist > > > > Steps to validate the release，Please refer to: > > https://linkis.apache.org/community/how-to-verify > > > > Thanks, > > On behalf of Apache Linkis(Incubating) community. > > > > - > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > > For additional commands, e-mail: general-h...@incubator.apache.org > > > > > > -- > > > -- > Best Regards > > DolphinScheduler PMC > Gang Li 李岗 > > lgcar...@apache.org >
Re: [DISCUSS] Incubating Proposal of DevLake
Hi Felix， Thanks for the kindly offering, I just added you into the mentor list of the proposal. Willem Jiang Twitter: willemjiang Weibo: 姜宁willem On Fri, Apr 8, 2022 at 2:45 AM Felix Cheung wrote: > > Interesting and unique project for incubator. > > Would love to help as mentor. > > > On Thu, Apr 7, 2022 at 1:22 AM Willem Jiang wrote: > > > We want to propose DevLake[1] as a new Apache Incubator project. > > > > DevLake helps developer teams integrate and analyze software > > development data throughout the software development life cycle > > (SDLC). > > Specifically, DevLake provides: > > > > * High-quality connectors that integrate data from various DevOps tools; > > * A comprehensive and unified data model and metrics that enable > > developers to easily query data and answer questions regarding their > > development process; > > * A plugin system that allows customizable data connectors and enrichers; > > * An unified ETL management module that orchestrates data collection > > and analysis. > > > > I'd be happy to be the Champion of this project and many thanks to > > Liang Zhang (zhangliang at apache dot org)，Lidong Dai (lidongdai at apache > > dot org)，Sijie Guo (sijie at apache dot org） for being the mentor of > > DevLake > > project and helping us to polish the incubating proposal[2]. > > > > Looking forward to your feedback and thank you very much. > > > > [1]https://github.com/merico-dev/lake > > [2]https://cwiki.apache.org/confluence/display/INCUBATOR/DevLakeProposal > > > > Willem Jiang > > > > Twitter: willemjiang > > Weibo: 姜宁willem > > > > - > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > > For additional commands, e-mail: general-h...@incubator.apache.org > > > > - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [VOTE] Release Apache Linkis (Incubating) 1.1.0-RC2
+1 (non-binding) I checked [OK] LICENSE and NOTICE files exist [OK] Include the word incubating in the release file name. [OK] DISCLAIMER-WIP file exists [OK] Signatures and hashes are fine [OK] Apache rat checks are OK [OK] Can compile from source. wangxiaogang 于2022年4月4日周一 17:34写道： > Hello Incubator Community, > > This is a call for vote to release Apache Linkis (Incubating) version > Release-1.1.0-RC2. > > The Apache Linkis community has voted on and approved a proposal to > release Apache Linkis(Incubating) version 1.1.0-RC2. We now kindly > request the Incubator PMC members review and vote on this incubator > release. > > Apache Linkis builds a computation middleware layer to decouple the > upper applications and the underlying data engines, provides > standardized interfaces (REST, JDBC, WebSocket etc.) to easily connect > to various underlying engines (Spark, Presto, Flink, etc.), while > enables cross engine context sharing, unified job & engine governance > and orchestration. > > Linkis community vote thread: > https://lists.apache.org/thread/vjqbyhdqtvqdy30s08rwo514s9dyts4w > > Linkis community vote result thread: > https://lists.apache.org/thread/97bdsv4s55kbbvgwvlck1xskm57xkt42 > > The release candidates: > https://dist.apache.org/repos/dist/dev/incubator/linkis/1.1.0-RC2/ > > Git tag for the release: > https://github.com/apache/incubator-linkis/releases/tag/release-1.1.0-rc2 > > Release notes: https://linkis.apache.org/docs/1.1.0/release-notes-1.1.0/ > > The artifacts signed with PGP key [6F179FBD], corresponding to [ > wangxiaog...@apache.org], that can be found in keys file: > https://downloads.apache.org/incubator/linkis/KEYS > > As the DISCLAIMER-WIP shows, this release still left some license > problems, which will be gradually resolved during incubation. > > The vote will be open for at least 72 hours or until the necessary number > of votes are reached. > > Please vote accordingly: > [ ] +1 approve > [ ] +0 no opinion > [ ] -1 disapprove with the reason > > More detail checklist please refer: > > > https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist > > Steps to validate the release，Please refer to: > https://linkis.apache.org/community/how-to-verify > > Thanks, > On behalf of Apache Linkis(Incubating) community. > > - > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org > > -- -- Best Regards DolphinScheduler PMC Gang Li 李岗 lgcar...@apache.org
[IP CLEARANCE] ShardingSphere Charts project contribution
Hi Incubator PMC, The TLP Apache ShardingSphere has been donated code for shardingsphere-charts, being merged to ShardingSphere master[1], old hostsd at SphereEx's repo[2]. This is the formal request for IP clearance to be checked as per [3]. The donated code can be found at [4] (*) See https://incubator.apache.org/ip-clearance/shardingsphere-charts.html The PMC has voted and passed to accept this donation. The ICLA of major contributors, Zhuo Li have been filed before. The SGA from SphereEx has been filed. The reason that SphereEx should submit SGA, because, in the old day, this project announced powered by SphereEx. Please vote to approve this contribution. This majority vote is open for at least 72 hours and as usual lazy consensus applies. [1] https://github.com/apache/shardingsphere/tree/master/shardingsphere-charts [2] https://github.com/SphereEx/shardingsphere-charts [3] https://incubator.apache.org/ip-clearance/ip-clearance-template.html#form-filling [4] https://issues.apache.org/jira/browse/INCUBATOR-272 -- Sincerely, Liang Zhang (John) Apache ShardingSphere
