Re: [DISCUSS] Gluten proposal

Cool. Can't wait to see this project to be an ASF project. 在 2024/1/4 10:12，“ShaoFeng Shi”mailto:shaofeng...@apache.org>> 写入: After discuss with the project team, we invited Felix Cheung into the mentor list (he is the first one expressed the willing for mentoring), and the proposal has been

Re: [DISCUSS] Gluten proposal

After discuss with the project team, we invited Felix Cheung into the mentor list (he is the first one expressed the willing for mentoring), and the proposal has been updated [1]; so far we have 5 mentors, we think that is a reasonable number for entering incubator. Thanks also to all others that

Re: [DISCUSS] Gluten proposal

Hi Kent, Thank you for the information from NetEase. As I know, Kyuubi + Spark + Gluten can be a typical high performance Lakehouse. Glad to see more innovations appears among them. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC, Apache Incubator PMC, Email: shaofeng...@apache.org Apache

Re: [DISCUSS] Gluten proposal

Hi Rakesh, Thank you for the comment! The Gluten community welcome everyone. I will discuss the mentorship with the project members, and let you know if need more mentors. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC, Apache Incubator PMC, Email: shaofeng...@apache.org Apache Kylin FAQ:

Re: [DISCUSS] Gluten proposal

Yu, thank you for the information. Glad to hear the feedback, and expect to see the collaboration with Flink in the new year! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC, Apache Incubator PMC, Email: shaofeng...@apache.org Apache Kylin FAQ:

Re: [DISCUSS] Gluten proposal

+1 Thank you Shaofeng for the details. I've connected with my colleagues at Microsoft and the project roadmap is super exciting to me. As my colleagues are part of various Apache projects Spark, Hadoop, Flink, Trino projects, I believe I can provide insights and add diversity to this project.

Re: [DISCUSS] Gluten proposal

+1, and I'm glad to be one of the nominated mentors. My team members at Alibaba deeply joined in the development of Gluten and Gluten-Trino, so I'm well aware that it's a diverse and open community, and really glad that the Gluten community decides to join the incubator. AFAIK, with Gluten-Trino

Re: [DISCUSS] Gluten proposal

+1 We have been using Glutin with Apache Kyuubi and Apache Spark at NetEase for about a year now. It's a promising project. And I'm glad to be one of the nominated mentors. Thanks, Kent Yao On 2023/12/28 03:25:56 ShaoFeng Shi wrote: > Hi Justin, > > Yeah, 12 months is a little tough; I have

Re: [DISCUSS] Gluten proposal

Hi Justin, Yeah, 12 months is a little tough; I have discussed this with the team, and updated the proposal to 18 months. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC, Apache Incubator PMC, Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html

Re: [DISCUSS] Gluten proposal

Hi Junping, Thank you for the suggestion. I have discussed this with the team, they agree with this. I have updated abstract part of the proposal. The slogan on the document website will be updated later. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC, Apache Incubator PMC, Email:

Re: [DISCUSS] Gluten proposal

Hi Rakesh, Yeah, the team aware that, they plan to merge the Trino plugin into the main repository at some point of time, depends on its maturity. The Hive plugin is not on current roadmap I think, but this is open for discussion. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC, Apache

Re: [DISCUSS] Gluten proposal

OK, that's really interesting. I hope you will add "Gluten-Trino " and "Gluten-Flink" as sub-projects(plugin module) under the main Gluten project and follow a single release cycle? Is it technically/architecturally feasible to develop a "Gluten-Hive"

Re: [DISCUSS] Gluten proposal

I am currently looking into gluten as well and have been looking ap spark acceleration in general. Available for contribution as well as mentoring. Thanks Venkat On Tue, Dec 26, 2023 at 9:53 PM Justin Mclean wrote: > Hi, > > Looks like a good proposal. Only one thing stood out to me, while

Re: [DISCUSS] Gluten proposal

Hi, Looks like a good proposal. Only one thing stood out to me, while not impossible, planning to graduate in a year might not be easily achievable. Kind Regards, Justn - To unsubscribe, e-mail:

Re: [DISCUSS] Gluten proposal

This is definitely an interesting project and I noticed this project from a very early stage. I saw many discussions above on if Gluten should be a subproject of Spark or not, and I can see the value to keep it independent just like Shaofeng's previous points. However, the project name or slogan -

Re: [DISCUSS] Gluten proposal

+1 I am delighted to see the proposal for Gluten and honored to be a mentor for this innovative project. I look forward to contributing my insights and helping guide Gluten through the incubation process. Thank you for this opportunity, and I am ready to support the project’s success. Best

Re: [DISCUSS] Gluten proposal

Hi Rakesh, Thanks for your comment. The Trino plugin is under PoC, not ready for widely use at this moment, so it is staged in another git repository: https://github.com/oap-project/Gluten-Trino Flink support is still in early discussion stage, need more collaboration in the future. Best

Re: [DISCUSS] Gluten proposal

Thanks Shaofeng and team for the efforts! Its really interesting to see that Flink and Trino projects can get the benefits of Gluten and boost their performance. Much appreciated, if you could share more on this integration, perf_numbers, pullrequest_reference, jira_reference etc. Will Flink and

Re: [DISCUSS] Gluten proposal

I've been keeping an eye on Gluten project since its starting up. And now, I'm so glad to see itsshowing up in the incubating discussion list. The aim of Gluten project is simple yet significant, with the high performance of native libraries, to speed up Spark Sql queries. Its architecture

Re: [DISCUSS] Gluten proposal

+1, Glad to see a better performance project Gluten can enter into the incubator. I'm very interested in high performance projects. I hope Gluten brings more possibilities for computational acceleration. Best Regards --- Apache DolphinScheduler PMC Chair & Apache SeaTunnel PMC

Re: [DISCUSS] Gluten proposal

Hello Felix, so far we have 4 mentors; I will contact you if need more. Thank you! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC, Apache Incubator PMC, Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group:

Re: [DISCUSS] Gluten proposal

Hi tison, I added myself into the mentor list just now, I will be there. Thanks for your suggestion! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC, Apache Incubator PMC, Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail

Re: [DISCUSS] Gluten proposal

Very interesting. Let me know if I can help as mentor On Sat, Dec 23, 2023 at 7:30 AM tison wrote: > Thanks for driving this proposal Shaofeng :D > > +1 to support this project entering the Incuabtor. It's in good shape > to develop an OSS project with a diverse group. Hopefully, the >

Re: [DISCUSS] Gluten proposal

Thanks for driving this proposal Shaofeng :D +1 to support this project entering the Incuabtor. It's in good shape to develop an OSS project with a diverse group. Hopefully, the Incubator can help it evaluate whether The Apache Way fits in its community and growth. One thing to be noticed is

Re: [DISCUSS] Gluten proposal

Hi Enrico, This is a good question. Actually I asked the same to the team when they find me for coaching. As the proposal mentioned, Gluten is a middle layer between the JVM-based SQL engine and native libraries. It connects the two sides, and build common services like unified plan

Re: [DISCUSS] Gluten proposal

Shaofeng, Il giorno ven 22 dic 2023 alle ore 13:59 ShaoFeng Shi ha scritto: > > Hi IPMC members, > > I would like to propose a new project to the ASF incubator - Gluten. > > Gluten[1] is a middle layer responsible for offloading Apache Spark SQL > queries to native engines. This project aims to

[DISCUSS] Gluten proposal

Hi IPMC members, I would like to propose a new project to the ASF incubator - Gluten. Gluten[1] is a middle layer responsible for offloading Apache Spark SQL queries to native engines. This project aims to address the CPU computational bottleneck to offload SparkSQL operators to native engines