Thanks for the clarification. I updated it to say Comet is in the process of being open sourced.
> On Feb 18, 2024, at 1:55 AM, Mich Talebzadeh <mich.talebza...@gmail.com> > wrote: > > Hi Matei, > > With regard to your last point > > "- Project Comet, a plugin designed to accelerate Spark query execution by > leveraging DataFusion and Arrow, has been open-sourced under the Apache Arrow > project. For more information, visit > https://github.com/apache/arrow-datafusion-comet."; > > If my understanding is correct (as of 15th February), I don't think the full > project is open sourced yet and I quote a response from the thead owner Chao > Sun > > "Note that we haven't open sourced several features yet including shuffle > support, which the aggregate operation depends on. Please stay tuned!" > > I would be inclined to leave that line out for now. The rest is fine. > > HTH > > Mich Talebzadeh, > Dad | Technologist | Solutions Architect | Engineer > London > United Kingdom > > view my Linkedin profile > <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> > > https://en.everybodywiki.com/Mich_Talebzadeh > > > Disclaimer: The information provided is correct to the best of my knowledge > but of course cannot be guaranteed . It is essential to note that, as with > any advice, one verified and tested result holds more weight than a thousand > expert opinions. > > > On Sat, 17 Feb 2024 at 19:23, Matei Zaharia <matei.zaha...@gmail.com > <mailto:matei.zaha...@gmail.com>> wrote: >> Hi all, >> >> I missed some reminder emails about our board report this month, but here is >> my draft. I’ll submit it tomorrow if that’s ok. >> >> ============== >> >> Issues for the board: >> >> - None >> >> Project status: >> >> - We made two patch releases: Spark 3.3.4 (EOL release) on December 16, >> 2023, and Spark 3.4.2 on November 30, 2023. >> - We have begun voting for a Spark 3.5.1 maintenance release. >> - The vote on "SPIP: Structured Streaming - Arbitrary State API v2" has >> passed. >> - We transitioned to an ASF-hosted analytics service, Matomo. For details, >> visit >> https://analytics.apache.org/index.php?module=CoreHome&action=index&date=yesterday&period=day&idSite=40. >> - Project Comet, a plugin designed to accelerate Spark query execution by >> leveraging DataFusion and Arrow, has been open-sourced under the Apache >> Arrow project. For more information, visit >> https://github.com/apache/arrow-datafusion-comet. >> >> Trademarks: >> >> - No changes since the last report. >> >> Latest releases: >> >> - Spark 3.3.4 was released on December 16, 2023 >> - Spark 3.4.2 was released on November 30, 2023 >> - Spark 3.5.0 was released on September 13, 2023 >> >> Committers and PMC: >> >> - The latest committer was added on Oct 2nd, 2023 (Jiaan Geng). >> - The latest PMC members were added on Oct 2nd, 2023 (Yuanjian Li and Yikun >> Jiang). >> >> ============== >> --------------------------------------------------------------------- >> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >> <mailto:dev-unsubscr...@spark.apache.org> >>
