Mich Talebzadeh, Technologist | Solutions Architect | Data Engineer | Generative AI London United Kingdom
view my Linkedin profile <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* The information provided is correct to the best of my knowledge but of course cannot be guaranteed . It is essential to note that, as with any advice, quote "one test result is worth one-thousand expert opinions (Werner <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von Braun <https://en.wikipedia.org/wiki/Wernher_von_Braun>)". ---------- Forwarded message --------- From: Mich Talebzadeh <mich.talebza...@gmail.com> Date: Sun, 7 Apr 2024 at 11:56 Subject: Re: Apache Spark 3.4.3 (?) To: Dongjoon Hyun <dongjoon.h...@gmail.com> Yes given that a good number of people are using some flavour of 3.4.n, this will be a good fit. +1 for me Mich Talebzadeh, Technologist | Solutions Architect | Data Engineer | Generative AI London United Kingdom view my Linkedin profile <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* The information provided is correct to the best of my knowledge but of course cannot be guaranteed . It is essential to note that, as with any advice, quote "one test result is worth one-thousand expert opinions (Werner <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von Braun <https://en.wikipedia.org/wiki/Wernher_von_Braun>)". On Sat, 6 Apr 2024 at 23:02, Dongjoon Hyun <dongjoon.h...@gmail.com> wrote: > Hi, All. > > Apache Spark 3.4.2 tag was created on Nov 24th and `branch-3.4` has 85 > commits including important security and correctness patches like > SPARK-45580, SPARK-46092, SPARK-46466, SPARK-46794, and SPARK-46862. > > https://github.com/apache/spark/releases/tag/v3.4.2 > > $ git log --oneline v3.4.2..HEAD | wc -l > 85 > > SPARK-45580 Subquery changes the output schema of the outer query > SPARK-46092 Overflow in Parquet row group filter creation causes incorrect > results > SPARK-46466 Vectorized parquet reader should never do rebase for timestamp > ntz > SPARK-46794 Incorrect results due to inferred predicate from checkpoint > with subquery > SPARK-46862 Incorrect count() of a dataframe loaded from CSV datasource > SPARK-45445 Upgrade snappy to 1.1.10.5 > SPARK-47428 Upgrade Jetty to 9.4.54.v20240208 > SPARK-46239 Hide `Jetty` info > > > Currently, I'm checking more applicable patches for branch-3.4. I'd like > to propose to release Apache Spark 3.4.3 and volunteer as the release > manager for Apache Spark 3.4.3. If there are no additional blockers, the > first tentative RC1 vote date is April 15th (Monday). > > WDYT? > > > Dongjoon. >