Thanks for driving this, Dongjoon! I know folks are testing and/or polishing some already merged features like CHECK constraints, MERGE schema evolution, DML metrics and VARIANT pushdown. It would be great to ensure those behave correctly once released.
I also continue working on fixes for the table lifecycle in DSv2 that lead to subtle correctness issues in Iceberg and Delta (e.g. SPARK-54022, SPARK-53924, SPARK-54157). These are long-standing issues (not regression) that would still be great to finally solve in 4.1. - Anton пн, 3 лист. 2025 р. о 18:28 Jungtaek Lim <[email protected]> пише: > Thanks for informing! > > Just to clarify, is the right to commit to the release branch during soft > feature freeze (e.g. branch-4.1 this time) lifted to PMC membership? I feel > like that was just missing, but just to confirm. > > Also while we are here, it might be good to understand what projects are > under 4.1 but yet to ship some functionalities/features planned for 4.1. I > guess soft feature freeze will let us decide where to cut the boundary of > functionality being shipped in 4.1 vs 4.2, but it might be good to put them > into the plate and have visibility and tracking of them. > > Thanks, > Jungtaek Lim > > On Sat, Nov 1, 2025 at 12:57 AM Dongjoon Hyun <[email protected]> wrote: > >> Hi, All. >> >> Hope you have a fun and safe Halloween evening! >> >> According to the Apache Spark versioning policy, `branch-4.1` will be >> created on November 1st as a way of soft feature freeze and a ramping down >> stage in order to stabilize new features. >> >> https://spark.apache.org/versioning-policy.html >> >> Note that it's a soft feature freeze. The Apache Spark PMC member can >> backport features from `master` to `branch-4.1` until November 15th. >> >> Lastly, Apache Spark 4.1.0-preview3 is provided to you to help your >> community evaluation, please try to use 4.1.0-preview3 and report us any >> issues. >> >> Thank you, >> Dongjoon Hyun. >> >
