malinjawi opened a new pull request, #12078: URL: https://github.com/apache/gluten/pull/12078
## What changes were proposed in this pull request? This PR fixes the nightly package failure for the Spark 4.1 + Delta 4.0 Velox build path. Changes: - Use explicit `SparkMDC.of(...)` calls in Delta 4.0 logging code so the import is used consistently across Spark 4.0 and Spark 4.1. - Add Spark 4.1 compatibility shims for Delta 4.0 references to the old streaming `CheckpointFileManager` and `MemoryStream` packages. - Add PR CI compile coverage for Spark 4.1 + Delta in the Velox x86 workflow so this package-only nightly failure is caught earlier. ## Why are the changes needed? The nightly package build compiles Spark 4.1 with `-Pdelta`, but PR CI only covered Delta on the Spark 4.0 fast-build path. Spark 4.1 changed the logging MDC shape and moved streaming APIs used by Delta 4.0, so the issue only surfaced in nightly packaging. ## How was this patch tested? - `./build/mvn -ntp -pl shims/spark41 clean install -Pspark-4.1 -Pscala-2.13 -Pjava-21 -DskipTests -Dmaven.source.skip` - `./build/mvn -ntp -pl backends-velox -am clean install -Pspark-4.1 -Pscala-2.13 -Pjava-21 -Pbackends-velox -Pceleborn -Puniffle -Pdelta -DskipTests -Dmaven.source.skip` - `./build/mvn -ntp -pl backends-velox -am clean install -Pspark-4.0 -Pscala-2.13 -Pjava-21 -Pbackends-velox -Pceleborn -Puniffle -Piceberg -Phudi -Pdelta -Ppaimon -DskipTests -Dmaven.source.skip` - `git diff --check` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
