I’ll mention that we’re working toward a preview release, even if the details are not finalized by the time we sent the report.
> On May 6, 2024, at 10:52 AM, Holden Karau <holden.ka...@gmail.com> wrote: > > I trust Wenchen to manage the preview release effectively but if there are > concerns around how to manage a developer preview release lets split that off > from the board report discussion. > > On Mon, May 6, 2024 at 10:44 AM Mich Talebzadeh <mich.talebza...@gmail.com > <mailto:mich.talebza...@gmail.com>> wrote: >> I did some historical digging on this. >> >> Whilst both preview release and RCs are pre-release versions, the main >> difference lies in their maturity and readiness for production use. Preview >> releases are early versions aimed at gathering feedback, while release >> candidates (RCs) are nearly finished versions that undergo final testing and >> voting before the official release. >> >> So in our case, we have two options: >> >> Skip mentioning of the Preview and focus on "We are intending to gather >> feedback on version 4 by releasing an earlier version to the community for >> look and feel feedback, especially focused on APIs >> Mention Preview in the form. "There will be a Preview release with the aim >> of gathering feedback from the community focused on APIs" >> IMO Preview release does not require a formal vote. Preview releases are >> often considered experimental or pre-alpha versions and are not expected to >> meet the same level of stability and completeness as release candidates or >> final releases. >> >> HTH >> >> Mich Talebzadeh, >> Technologist | Architect | Data Engineer | Generative AI | FinCrime >> >> London >> United Kingdom >> >> view my Linkedin profile >> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> >> >> https://en.everybodywiki.com/Mich_Talebzadeh >> >> >> Disclaimer: The information provided is correct to the best of my knowledge >> but of course cannot be guaranteed . It is essential to note that, as with >> any advice, quote "one test result is worth one-thousand expert opinions >> (Werner <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von Braun >> <https://en.wikipedia.org/wiki/Wernher_von_Braun>)". >> >> >> On Mon, 6 May 2024 at 14:10, Mich Talebzadeh <mich.talebza...@gmail.com >> <mailto:mich.talebza...@gmail.com>> wrote: >>> @Wenchen Fan <mailto:cloud0...@gmail.com> >>> >>> Thanks for the update! To clarify, is the vote for approving a specific >>> preview build, or is it for moving towards an RC stage? I gather there is a >>> distinction between these two? >>> >>> >>> Mich Talebzadeh, >>> Technologist | Architect | Data Engineer | Generative AI | FinCrime >>> >>> London >>> United Kingdom >>> >>> view my Linkedin profile >>> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> >>> >>> https://en.everybodywiki.com/Mich_Talebzadeh >>> >>> >>> Disclaimer: The information provided is correct to the best of my knowledge >>> but of course cannot be guaranteed . It is essential to note that, as with >>> any advice, quote "one test result is worth one-thousand expert opinions >>> (Werner <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von Braun >>> <https://en.wikipedia.org/wiki/Wernher_von_Braun>)". >>> >>> >>> On Mon, 6 May 2024 at 13:03, Wenchen Fan <cloud0...@gmail.com >>> <mailto:cloud0...@gmail.com>> wrote: >>>> The preview release also needs a vote. I'll try my best to cut the RC on >>>> Monday, but the actual release may take some time. Hopefully, we can get >>>> it out this week but if the vote fails, it will take longer as we need >>>> more RCs. >>>> >>>> On Mon, May 6, 2024 at 7:22 AM Dongjoon Hyun <dongjoon.h...@gmail.com >>>> <mailto:dongjoon.h...@gmail.com>> wrote: >>>>> +1 for Holden's comment. Yes, it would be great to mention `it` as >>>>> "soon". >>>>> (If Wenchen release it on Monday, we can simply mention the release) >>>>> >>>>> In addition, Apache Spark PMC received an official notice from ASF Infra >>>>> team. >>>>> >>>>> https://lists.apache.org/thread/rgy1cg17tkd3yox7qfq87ht12sqclkbg >>>>> > [NOTICE] Apache Spark's GitHub Actions usage exceeds allowances for ASF >>>>> > projects >>>>> >>>>> To track and comply with the new ASF Infra Policy as much as possible, we >>>>> opened a blocker-level JIRA issue and have been working on it. >>>>> - https://infra.apache.org/github-actions-policy.html >>>>> >>>>> Please include a sentence that Apache Spark PMC is working on under the >>>>> following umbrella JIRA issue. >>>>> >>>>> https://issues.apache.org/jira/browse/SPARK-48094 >>>>> > Reduce GitHub Action usage according to ASF project allowance >>>>> >>>>> Thanks, >>>>> Dongjoon. >>>>> >>>>> >>>>> On Sun, May 5, 2024 at 3:45 PM Holden Karau <holden.ka...@gmail.com >>>>> <mailto:holden.ka...@gmail.com>> wrote: >>>>>> Do we want to include that we’re planning on having a preview release of >>>>>> Spark 4 so folks can see the APIs “soon”? >>>>>> >>>>>> Twitter: https://twitter.com/holdenkarau >>>>>> Books (Learning Spark, High Performance Spark, etc.): >>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> >>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau >>>>>> >>>>>> >>>>>> On Sun, May 5, 2024 at 3:24 PM Matei Zaharia <matei.zaha...@gmail.com >>>>>> <mailto:matei.zaha...@gmail.com>> wrote: >>>>>>> It’s time for our quarterly ASF board report on Apache Spark this >>>>>>> Wednesday. Here’s a draft, feel free to suggest changes. >>>>>>> >>>>>>> ==================== >>>>>>> >>>>>>> Description: >>>>>>> >>>>>>> Apache Spark is a fast and general purpose engine for large-scale data >>>>>>> processing. It offers high-level APIs in Java, Scala, Python, R and SQL >>>>>>> as well as a rich set of libraries including stream processing, machine >>>>>>> learning, and graph analytics. >>>>>>> >>>>>>> Issues for the board: >>>>>>> >>>>>>> - None >>>>>>> >>>>>>> Project status: >>>>>>> >>>>>>> - We made two patch releases: Spark 3.5.1 on February 28, 2024, and >>>>>>> Spark 3.4.2 on April 18, 2024. >>>>>>> - The votes on "SPIP: Structured Logging Framework for Apache Spark" >>>>>>> and "Pure Python Package in PyPI (Spark Connect)" have passed. >>>>>>> - The votes for two behavior changes have passed: "SPARK-44444: Use >>>>>>> ANSI SQL mode by default" and "SPARK-46122: Set >>>>>>> spark.sql.legacy.createHiveTableByDefault to false". >>>>>>> - The community decided that upcoming Spark 4.0 release will drop >>>>>>> support for Python 3.8. >>>>>>> - We started a discussion about the definition of behavior changes that >>>>>>> is critical for version upgrades and user experience. >>>>>>> - We've opened a dedicated repository for the Spark Kubernetes Operator >>>>>>> at https://github.com/apache/spark-kubernetes-operator. We added a new >>>>>>> version in Apache Spark JIRA for versioning of the Spark operator based >>>>>>> on a vote result. >>>>>>> >>>>>>> Trademarks: >>>>>>> >>>>>>> - No changes since the last report. >>>>>>> >>>>>>> Latest releases: >>>>>>> - Spark 3.4.3 was released on April 18, 2024 >>>>>>> - Spark 3.5.1 was released on February 28, 2024 >>>>>>> - Spark 3.3.4 was released on December 16, 2023 >>>>>>> >>>>>>> Committers and PMC: >>>>>>> >>>>>>> - The latest committer was added on Oct 2nd, 2023 (Jiaan Geng). >>>>>>> - The latest PMC members were added on Oct 2nd, 2023 (Yuanjian Li and >>>>>>> Yikun Jiang). >>>>>>> >>>>>>> ==================== >>>>>>> --------------------------------------------------------------------- >>>>>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >>>>>>> <mailto:dev-unsubscr...@spark.apache.org> >>>>>>> > > > -- > Twitter: https://twitter.com/holdenkarau > Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 > <https://amzn.to/2MaRAG9> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
