If folks are against the term soon we could say “in-progress” Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
On Mon, May 6, 2024 at 2:08 AM Mich Talebzadeh <mich.talebza...@gmail.com> wrote: > Hi, > > We should reconsider using the term "soon" for ASF board as it is > subjective with no date (assuming this is an official communication on > Wednesday). We ought to say > > "Spark 4, the next major release after Spark 3.x, is currently under > development. We plan to make a preview version available for evaluation as > soon as it is feasible" > > HTH > > Mich Talebzadeh, > Technologist | Architect | Data Engineer | Generative AI | FinCrime > London > United Kingdom > > > view my Linkedin profile > <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> > > > https://en.everybodywiki.com/Mich_Talebzadeh > > > > *Disclaimer:* The information provided is correct to the best of my > knowledge but of course cannot be guaranteed . It is essential to note > that, as with any advice, quote "one test result is worth one-thousand > expert opinions (Werner <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von > Braun <https://en.wikipedia.org/wiki/Wernher_von_Braun>)". > > > On Mon, 6 May 2024 at 05:09, Dongjoon Hyun <dongjoon.h...@gmail.com> > wrote: > >> +1 for Holden's comment. Yes, it would be great to mention `it` as >> "soon". >> (If Wenchen release it on Monday, we can simply mention the release) >> >> In addition, Apache Spark PMC received an official notice from ASF Infra >> team. >> >> https://lists.apache.org/thread/rgy1cg17tkd3yox7qfq87ht12sqclkbg >> > [NOTICE] Apache Spark's GitHub Actions usage exceeds allowances for ASF >> projects >> >> To track and comply with the new ASF Infra Policy as much as possible, we >> opened a blocker-level JIRA issue and have been working on it. >> - https://infra.apache.org/github-actions-policy.html >> >> Please include a sentence that Apache Spark PMC is working on under the >> following umbrella JIRA issue. >> >> https://issues.apache.org/jira/browse/SPARK-48094 >> > Reduce GitHub Action usage according to ASF project allowance >> >> Thanks, >> Dongjoon. >> >> >> On Sun, May 5, 2024 at 3:45 PM Holden Karau <holden.ka...@gmail.com> >> wrote: >> >>> Do we want to include that we’re planning on having a preview release of >>> Spark 4 so folks can see the APIs “soon”? >>> >>> Twitter: https://twitter.com/holdenkarau >>> Books (Learning Spark, High Performance Spark, etc.): >>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> >>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau >>> >>> >>> On Sun, May 5, 2024 at 3:24 PM Matei Zaharia <matei.zaha...@gmail.com> >>> wrote: >>> >>>> It’s time for our quarterly ASF board report on Apache Spark this >>>> Wednesday. Here’s a draft, feel free to suggest changes. >>>> >>>> ==================== >>>> >>>> Description: >>>> >>>> Apache Spark is a fast and general purpose engine for large-scale data >>>> processing. It offers high-level APIs in Java, Scala, Python, R and SQL as >>>> well as a rich set of libraries including stream processing, machine >>>> learning, and graph analytics. >>>> >>>> Issues for the board: >>>> >>>> - None >>>> >>>> Project status: >>>> >>>> - We made two patch releases: Spark 3.5.1 on February 28, 2024, and >>>> Spark 3.4.2 on April 18, 2024. >>>> - The votes on "SPIP: Structured Logging Framework for Apache Spark" >>>> and "Pure Python Package in PyPI (Spark Connect)" have passed. >>>> - The votes for two behavior changes have passed: "SPARK-44444: Use >>>> ANSI SQL mode by default" and "SPARK-46122: Set >>>> spark.sql.legacy.createHiveTableByDefault to false". >>>> - The community decided that upcoming Spark 4.0 release will drop >>>> support for Python 3.8. >>>> - We started a discussion about the definition of behavior changes that >>>> is critical for version upgrades and user experience. >>>> - We've opened a dedicated repository for the Spark Kubernetes Operator >>>> at https://github.com/apache/spark-kubernetes-operator. We added a new >>>> version in Apache Spark JIRA for versioning of the Spark operator based on >>>> a vote result. >>>> >>>> Trademarks: >>>> >>>> - No changes since the last report. >>>> >>>> Latest releases: >>>> - Spark 3.4.3 was released on April 18, 2024 >>>> - Spark 3.5.1 was released on February 28, 2024 >>>> - Spark 3.3.4 was released on December 16, 2023 >>>> >>>> Committers and PMC: >>>> >>>> - The latest committer was added on Oct 2nd, 2023 (Jiaan Geng). >>>> - The latest PMC members were added on Oct 2nd, 2023 (Yuanjian Li and >>>> Yikun Jiang). >>>> >>>> ==================== >>>> --------------------------------------------------------------------- >>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >>>> >>>>