Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-11 Thread Kent Yao
Hello everyone, It's been 12 days since this discussion started on May 31, 2021. After June 6, there are no more new questions arising. So I'd like to summarize the results of this discussion so we can move forward. Thank you very much to everyone at the Apache IPMC for suggesting changes to our

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-06 Thread Kent Yao
Hi Ming, Thanks for your question. As mentioned in the proposal, Kyuubi was first developed and applied in NetEase in 2018. The early scenario we wanted to address was straightforward - to provide data analysts with a Spark-based analytics platform. This platform needed to support multi-tenancy

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-05 Thread Ming Wen
You can see the trend chart from https://www.apiseven.com/zh/contributor-graph?chart=contributorMonthlyActivity=NetEase/kyuubi Ming Wen 于2021年6月6日 周日上午7:28写道: > hi, Kent, > > From 2018 to 2020, kuyybi is not an active project, most of the time there > is only one contributor per month. But in

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-05 Thread Ming Wen
hi, Kent, >From 2018 to 2020, kuyybi is not an active project, most of the time there is only one contributor per month. But in 2021, there will be 8 active contributors every month. What is the reason for this? Willem Jiang 于2021年6月3日 周四下午12:53写道: > I think we can revisit the PPMC part and

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread Willem Jiang
I think we can revisit the PPMC part and have more discussion with the initial committers. It's a good chance to let them know better about how to run an open source project in Apache Way. Willem Jiang Twitter: willemjiang Weibo: 姜宁willem On Thu, Jun 3, 2021 at 11:52 AM Atri Sharma wrote: >

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread Akira Ajisaka
Hi Atri, I've checked the contribution this year: https://github.com/NetEase/kyuubi/graphs/contributors?from=2021-01-01=2021-05-31=c According to this page, I don't think one contributor/company is dominating. The number of active developers is 4, which is currently low, but I think it is

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread Willem Jiang
Hi Atri, I shared the same concern with you when Kent Yao came to me two month ago. I think he already realized it and made some improvements recently. He told me he want to build up the community around Sparks ecosystem by donating this project into ASF last week. He did a presentation about it

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread hddong
+1 Kyuubi is useful for us. In chinamobile soft's big data platform, we use kyuubi to solve the problem of multi tenant access for a long time. It's helpful and easy to use. I just joined Kyuubi community for a short time, but I really enjoy the process of cooperation with the community. I

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread Atri Sharma
I would like to hear from Kyuubi's mentors on the topic before reaching a conclusion. On Thu, 3 Jun 2021, 05:40 Sheng Wu, wrote: > Kent > > Thanks. > The proposal is generally better this time. > > If your initial committers and your mentors agree, you are ready to embrace > the ASF culture, I

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread Kent Yao
Thanks very much, Sheng :) Sheng Wu 于2021年6月3日周四 上午8:10写道: > Kent > > Thanks. > The proposal is generally better this time. > > If your initial committers and your mentors agree, you are ready to embrace > the ASF culture, I am good with that. > Just from my experience, your community looks a

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread Kent Yao
Hi Justion, Thanks for your suggestions. We won't copy their bar blindly from the Spark community. We appreciate all the help from our contributors and will try our best to help them when they help the community. We will continue to develop more committers among them to make the community grow

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread Sheng Wu
Kent Thanks. The proposal is generally better this time. If your initial committers and your mentors agree, you are ready to embrace the ASF culture, I am good with that. Just from my experience, your community looks a little too young, like Atri's concern, which is reasonable. But I would like

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread Justin Mclean
HI, > We've open-sourced Kyuubi under Apache License v2.0 and tried out best to > learn the Apache Way from many mature ASF TLPs, mostly Apache Spark. Spark is a sightly unusual project that has high activity and a very high committer bar, I wouldn’t recommend that you copy that feature of

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread Kent Yao
Hi Sheng, Truly sorry for the format issue. Please trust me I did not mean to hurt anybody and push any contributor away. We drafted this proposal together based on the New Podling Proposal. We never tried to use PPMC and committer to measure whose contribution is higher. This mistake has been

RE: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread Cheng Pan
Hi all, Thanks for the review and questions. I'm one of the Kyuubi committers, and have participated in the recent 6 months, include code changes[1], PR reviews, documents improvements, discussions, etc. I'd like to say, both Kent and other committers are nice and patient persons, and most

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread Atri Sharma
I am genuinely worried about one contributor being the dominant of all. This puts the stability of the project in jeopardy and unless this is remedied, I feel the project should focus on developing a more diverse community first. On Wed, 2 Jun 2021, 20:23 Sheng Wu, wrote: > Hi Kent > > Thanks

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread Sheng Wu
Hi Kent Thanks for replying, but to be honest, your mail format is chaos. Take a look at bellowing, which is what I saw in the gmail. This may be an issue of your mail client or some else. > The current #.2 - 5 top > contributors will stay as committers, and they will join the PPMC during >

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread Kent Yao
Hi Leo, Thanks for sharing, this is helpful. Looking forward to Bigo joining Kyuubi:) Bests, Kent Yao liyihe 于2021年6月2日周三 下午9:01写道: > Kyuubi has been used in Bigo’s bigdata platform for a long time. Very > helpful to us. Looking forward to Kyuubi becoming an ASF project. > Best regards, >

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread Kent Yao
Hi Sheng, Thanks for your detailed check and valuable comments. They are accommodating. I have addressed some of them directly in the proposal. Please also check the table below for some Q QA You listed only 5 core maintainers, but clearly only one has dominated contributions. The distortion and

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread liyihe
Kyuubi has been used in Bigo’s bigdata platform for a long time. Very helpful to us. Looking forward to Kyuubi becoming an ASF project. Best regards, Leo Li

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread Sheng Wu
Hi I read the contributor list and the proposal > The risk of the Kyuubi project being abandoned is minimal. Many organizations are using Kyuubi to build critical big data pipelines and willing to help develop Kyuubi's community if it becomes an ASF project. I think the team should evaluate the

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread Kent Yao
Hi Atri Sharma, I just notice that you might mean '3 years' not '3 months' in your first mail, LOL. Sorry for the confusion. After borrowed the PR merge tool[1] from one Apache project to learn how they manage PR and commits, we start to use it to merge PRs, which squashes all commits in one

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread chuan jin
Nice job, i am looking foward to more interesting feature. On 2021/05/31 06:21:14, Kent Yao wrote: > Dear all, > > We want to propose Kyuubi as a new Apache Incubator project. > > Kyuubi is a distributed multi-tenant Thrift JDBC/ODBC server for > large-scale data management, processing, and

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread bei peng
looks like a very practical project - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread 陈洪
looks niubility On 2021/05/31 06:21:14, Kent Yao wrote: > Dear all, > > We want to propose Kyuubi as a new Apache Incubator project. > > Kyuubi is a distributed multi-tenant Thrift JDBC/ODBC server for > large-scale data management, processing, and analytics, built on top > of Apache Spark

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread hang zheng
looks useful On 2021/05/31 06:21:14, Kent Yao wrote: > Dear all, > > We want to propose Kyuubi as a new Apache Incubator project. > > Kyuubi is a distributed multi-tenant Thrift JDBC/ODBC server for > large-scale data management, processing, and analytics, built on top > of Apache Spark and

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread 温正湖
+1 (non-binding) for incubation. On 2021/05/31 07:29:31, Kent Yao wrote: > Hi Alexander Alten, > > Thanks for your interest and +1 for Kyuubi. > > Not being very familiar with Dremel, I just took a quick look at the > profile of a very similar and exciting project, Apache Drill. If I >

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread Atri Sharma
Thanks. I looked at the link you advised on and if I am reading it correctly, top committer has 630ish commits and the next committer has 73 commits? IMO this is an indication of the community not being active enough and hence the risk of project getting orphaned is measurable. Atri On Wed, 2

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread hang zheng
looks interesting On 2021/05/31 06:21:14, Kent Yao wrote: > Dear all, > > We want to propose Kyuubi as a new Apache Incubator project. > > Kyuubi is a distributed multi-tenant Thrift JDBC/ODBC server for > large-scale data management, processing, and analytics, built on top > of Apache Spark

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-02 Thread libis
+1 (non-binding). On 2021/05/31 06:21:14, Kent Yao wrote: > Dear all,> > > We want to propose Kyuubi as a new Apache Incubator project.> > > Kyuubi is a distributed multi-tenant Thrift JDBC/ODBC server for> > large-scale data management, processing, and analytics, built on top> > of Apache Spark

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-01 Thread Willem Jiang
Hi Atri Sharma, It's easier to check out the recent contribution of kyuubi from this link[1]. We already identified the one person contribution issue of kyuubi when Kent came to us and we kept reminding him to put more effort into building the community. Last week I had a long F2F conversation

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-01 Thread Kent Yao
Hi Atri Sharma, Thanks for your interest and review. We've open-sourced Kyuubi under Apache License v2.0 and tried out best to learn the Apache Way from many mature ASF TLPs, mostly Apache Spark. And many of the current Kyuubi committers have contributing history for one or more Apache projects.

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-01 Thread Atri Sharma
Hi, I took a look at commit log and seems like all the commits for last 3 months have been done by a single person. How active are the remaining committers? On Mon, 31 May 2021, 12:59 Kent Yao, wrote: > Hi Alexander Alten, > > Thanks for your interest and +1 for Kyuubi. > > Not being very

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-06-01 Thread Wang, Fei
+1 (non-binding). Good luck. Regards, Fei On 2021/5/31, 3:45 PM, "Kent Yao" wrote: External Email Hi Jean-Baptiste Onofre, thanks for your reply. You are correct. And we are focusing on the part processing with Spark not storage with Hive. Since Spark provides

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-05-31 Thread Kent Yao
Hi Jean-Baptiste Onofre, thanks for your reply. You are correct. And we are focusing on the part processing with Spark not storage with Hive. Since Spark provides Datasource V2, the data access and connectivity need not bind to Hive in the Spark layer, it becomes more and more promising. Bests

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-05-31 Thread Kent Yao
Hi Alexander Alten, Thanks for your interest and +1 for Kyuubi. Not being very familiar with Dremel, I just took a quick look at the profile of a very similar and exciting project, Apache Drill. If I understand correctly, Kyuubi is built on top of the compute layer (Apache Spark), while Apache

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-05-31 Thread Jean-Baptiste Onofre
Hi Kent Yao, It looks interesting. Correct me if I’m wrong, but it seems to be more a SQL gateway, more than a "server", meaning that the storage is delegated to Hive and processing to Spark, right ? Regards JB > Le 31 mai 2021 à 08:21, Kent Yao a écrit : > > Dear all, > > We want to

Re: [DISCUSS] Incubating Proposal of Kyuubi

2021-05-31 Thread Alexander Alten
Hey, Looks like an interesting project, competition to Starburst. How does it compare to Apache Dremel? +1 (non-binding) for incubation. Thanks and stay safe, --alex On Mon, May 31, 2021, 08:21 Kent Yao wrote: > Dear all, > > We want to propose Kyuubi as a new Apache Incubator project. > >