rdtr opened a new issue, #13573:
URL: https://github.com/apache/gluten/issues/13573

   ### Description
   
   ### Description
   
   Spark 3.4 reached EOL in October 2024. 3.4.4, tagged on 2024-10-21, was its 
last release. In #13524, LuciferYang proposed removing it from main now, the 
same way Spark 3.3 was removed under #12807. This issue tracks the same four 
steps.
   
   - [ ] Migrate Spark 3.4-only test coverage to Spark 3.5+. One 
Gluten-authored case lives only in `gluten-ut/spark34`: `GlutenInsertSuite`'s 
`offload empty2null when v1writes fallback`, added by #6859.
   - [ ] Remove the Spark 3.4 profile, the shim and UT modules 
(`shims/spark34`, `gluten-ut/spark34`), the Delta Lake 2.4 sources 
(`gluten-delta/src-delta24`), Bolt's `src-iceberg-spark34`, the 3.4 CI jobs and 
the build scripts.
   - [ ] Clean up the shim APIs that exist only because Spark 3.4 differs from 
later versions (like #12954 for 3.3).
   - [ ] Remove the leftover Spark 3.4 version checks: the Spark 3.4 deletion 
vector fallback in `OffloadDeltaScan`, `startsWith("3.4")` checks in tests, and 
the `testWithMinSparkVersion(..., "3.4")` / `"3.5"` gates that become constant 
(like #12981 and #12992).
   
   ### Gluten version
   
   main branch


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to