dongjoon-hyun opened a new pull request, #761: URL: https://github.com/apache/spark-kubernetes-operator/pull/761
### What changes were proposed in this pull request? This PR aims to use Apache Spark 4.2.0 docker images instead of `4.1.2` and `4.2.0-preview5`. - Rename `pi-preview*` examples and the `pi-preview` E2E test to `pi-java25*` with `apache/spark:4.2.0-scala-java25` image. - Update all examples, E2E tests, benchmark script, and docs from `4.1.2` to `4.2.0`. - Update the default Spark cluster image of `SparkClusterResourceSpec` from `apache/spark:4.1.2` to `apache/spark:4.2.0`. Note that `pi-with-comet.yaml` stays on `4.1.2` because `Apache DataFusion Comet` does not provide a Spark 4.2 artifact yet, like `pi-with-gluten.yaml` stays on `4.0.3`. ### Why are the changes needed? Since Apache Spark 4.2.0 is released, the examples and tests should use the official release images instead of the preview and old versions. The build dependency is already on Spark 4.2.0 in `gradle/libs.versions.toml`. ### Does this PR introduce _any_ user-facing change? Yes, the default Spark cluster image becomes `apache/spark:4.2.0`, and the examples are updated. However, this is a consistent behavior change with the already-upgraded Spark 4.2.0 dependency. ### How was this patch tested? Pass the CIs including the renamed `pi-java25` E2E test group. ### Was this patch authored or co-authored using generative AI tooling? Generated-by: Claude Fable 5 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
