I trust Wenchen to manage the preview release effectively but if there are concerns around how to manage a developer preview release lets split that off from the board report discussion.
On Mon, May 6, 2024 at 10:44 AM Mich Talebzadeh <mich.talebza...@gmail.com> wrote: > I did some historical digging on this. > > Whilst both preview release and RCs are pre-release versions, the main > difference lies in their maturity and readiness for production use. Preview > releases are early versions aimed at gathering feedback, while release > candidates (RCs) are nearly finished versions that undergo final testing > and voting before the official release. > > So in our case, we have two options: > > > 1. Skip mentioning of the Preview and focus on "We are intending to > gather feedback on version 4 by releasing an earlier version to the > community for look and feel feedback, especially focused on APIs > 2. Mention Preview in the form. "There will be a Preview release with > the aim of gathering feedback from the community focused on APIs" > > IMO Preview release does not require a formal vote. Preview releases are > often considered experimental or pre-alpha versions and are not expected to > meet the same level of stability and completeness as release candidates or > final releases. > > HTH > > Mich Talebzadeh, > Technologist | Architect | Data Engineer | Generative AI | FinCrime > London > United Kingdom > > > view my Linkedin profile > <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> > > > https://en.everybodywiki.com/Mich_Talebzadeh > > > > *Disclaimer:* The information provided is correct to the best of my > knowledge but of course cannot be guaranteed . It is essential to note > that, as with any advice, quote "one test result is worth one-thousand > expert opinions (Werner <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von > Braun <https://en.wikipedia.org/wiki/Wernher_von_Braun>)". > > > On Mon, 6 May 2024 at 14:10, Mich Talebzadeh <mich.talebza...@gmail.com> > wrote: > >> @Wenchen Fan <cloud0...@gmail.com> >> >> Thanks for the update! To clarify, is the vote for approving a specific >> preview build, or is it for moving towards an RC stage? I gather there is a >> distinction between these two? >> >> >> Mich Talebzadeh, >> Technologist | Architect | Data Engineer | Generative AI | FinCrime >> London >> United Kingdom >> >> >> view my Linkedin profile >> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> >> >> >> https://en.everybodywiki.com/Mich_Talebzadeh >> >> >> >> *Disclaimer:* The information provided is correct to the best of my >> knowledge but of course cannot be guaranteed . It is essential to note >> that, as with any advice, quote "one test result is worth one-thousand >> expert opinions (Werner >> <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von Braun >> <https://en.wikipedia.org/wiki/Wernher_von_Braun>)". >> >> >> On Mon, 6 May 2024 at 13:03, Wenchen Fan <cloud0...@gmail.com> wrote: >> >>> The preview release also needs a vote. I'll try my best to cut the RC on >>> Monday, but the actual release may take some time. Hopefully, we can get it >>> out this week but if the vote fails, it will take longer as we need more >>> RCs. >>> >>> On Mon, May 6, 2024 at 7:22 AM Dongjoon Hyun <dongjoon.h...@gmail.com> >>> wrote: >>> >>>> +1 for Holden's comment. Yes, it would be great to mention `it` as >>>> "soon". >>>> (If Wenchen release it on Monday, we can simply mention the release) >>>> >>>> In addition, Apache Spark PMC received an official notice from ASF >>>> Infra team. >>>> >>>> https://lists.apache.org/thread/rgy1cg17tkd3yox7qfq87ht12sqclkbg >>>> > [NOTICE] Apache Spark's GitHub Actions usage exceeds allowances for >>>> ASF projects >>>> >>>> To track and comply with the new ASF Infra Policy as much as possible, >>>> we opened a blocker-level JIRA issue and have been working on it. >>>> - https://infra.apache.org/github-actions-policy.html >>>> >>>> Please include a sentence that Apache Spark PMC is working on under the >>>> following umbrella JIRA issue. >>>> >>>> https://issues.apache.org/jira/browse/SPARK-48094 >>>> > Reduce GitHub Action usage according to ASF project allowance >>>> >>>> Thanks, >>>> Dongjoon. >>>> >>>> >>>> On Sun, May 5, 2024 at 3:45 PM Holden Karau <holden.ka...@gmail.com> >>>> wrote: >>>> >>>>> Do we want to include that we’re planning on having a preview release >>>>> of Spark 4 so folks can see the APIs “soon”? >>>>> >>>>> Twitter: https://twitter.com/holdenkarau >>>>> Books (Learning Spark, High Performance Spark, etc.): >>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> >>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau >>>>> >>>>> >>>>> On Sun, May 5, 2024 at 3:24 PM Matei Zaharia <matei.zaha...@gmail.com> >>>>> wrote: >>>>> >>>>>> It’s time for our quarterly ASF board report on Apache Spark this >>>>>> Wednesday. Here’s a draft, feel free to suggest changes. >>>>>> >>>>>> ==================== >>>>>> >>>>>> Description: >>>>>> >>>>>> Apache Spark is a fast and general purpose engine for large-scale >>>>>> data processing. It offers high-level APIs in Java, Scala, Python, R and >>>>>> SQL as well as a rich set of libraries including stream processing, >>>>>> machine >>>>>> learning, and graph analytics. >>>>>> >>>>>> Issues for the board: >>>>>> >>>>>> - None >>>>>> >>>>>> Project status: >>>>>> >>>>>> - We made two patch releases: Spark 3.5.1 on February 28, 2024, and >>>>>> Spark 3.4.2 on April 18, 2024. >>>>>> - The votes on "SPIP: Structured Logging Framework for Apache Spark" >>>>>> and "Pure Python Package in PyPI (Spark Connect)" have passed. >>>>>> - The votes for two behavior changes have passed: "SPARK-44444: Use >>>>>> ANSI SQL mode by default" and "SPARK-46122: Set >>>>>> spark.sql.legacy.createHiveTableByDefault to false". >>>>>> - The community decided that upcoming Spark 4.0 release will drop >>>>>> support for Python 3.8. >>>>>> - We started a discussion about the definition of behavior changes >>>>>> that is critical for version upgrades and user experience. >>>>>> - We've opened a dedicated repository for the Spark Kubernetes >>>>>> Operator at https://github.com/apache/spark-kubernetes-operator. We >>>>>> added a new version in Apache Spark JIRA for versioning of the Spark >>>>>> operator based on a vote result. >>>>>> >>>>>> Trademarks: >>>>>> >>>>>> - No changes since the last report. >>>>>> >>>>>> Latest releases: >>>>>> - Spark 3.4.3 was released on April 18, 2024 >>>>>> - Spark 3.5.1 was released on February 28, 2024 >>>>>> - Spark 3.3.4 was released on December 16, 2023 >>>>>> >>>>>> Committers and PMC: >>>>>> >>>>>> - The latest committer was added on Oct 2nd, 2023 (Jiaan Geng). >>>>>> - The latest PMC members were added on Oct 2nd, 2023 (Yuanjian Li and >>>>>> Yikun Jiang). >>>>>> >>>>>> ==================== >>>>>> --------------------------------------------------------------------- >>>>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >>>>>> >>>>>> -- Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
