sekikn opened a new pull request, #1311:
URL: https://github.com/apache/bigtop/pull/1311
<!--
Thanks for sending a pull request!
1. If this is your first time, please read our contributor guidelines:
https://cwiki.apache.org/confluence/display/BIGTOP/How+to+Contribute
2. Make sure your PR title starts with JIRA issue id, e.g.,
'BIGTOP-3638: Your PR title ...'.
-->
### Description of PR
This PR upgrades Spark to 3.5.3 for the Bigtop 3.4.0 release.
### How was this patch tested?
After applying #1310 and this PR, Spark 3.5.3 was successfully built on
Debian 11 and Rocky 9 (x86_64).
```
$ ./gradlew toolchain
$ mvn -version
Apache Maven 3.9.9 (8e8579a9e76f7d015ee5ec7bfcdc97d260186937)
(snip)
$ ./gradlew spark-clean spark-pkg repo -Dbuildwithdeps=true
(snip)
BUILD SUCCESSFUL in 46m 8s
34 actionable tasks: 34 executed
```
The smoke test also passed on Debian 11.
```
$ cd provisioner/docker
$ ./docker-hadoop.sh -d -dcp -C config_debian-11.yaml -F
docker-compose-cgroupv2.yml -G -L -k hdfs,yarn,spark -s spark -c 3
(snip)
> Task :bigtop-tests:smoke-tests:spark:test
Finished generating test XML results (0.016 secs) into:
/bigtop-home/bigtop-tests/smoke-tests/spark/build/test-results/test
Generating HTML test report...
Finished generating test html results (0.023 secs) into:
/bigtop-home/bigtop-tests/smoke-tests/spark/build/reports/tests/test
Now testing...
:bigtop-tests:smoke-tests:spark:test (Thread[Execution worker for
':',5,main]) completed. Took 50.167 secs.
BUILD SUCCESSFUL in 1m 15s
27 actionable tasks: 7 executed, 20 up-to-date
```
### For code changes:
- [x] Does the title or this PR starts with the corresponding JIRA issue id
(e.g. 'BIGTOP-3638. Your PR title ...')?
- [x] Make sure that newly added files do not have any licensing issues.
When in doubt refer to https://www.apache.org/licenses/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
