This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push: new c1a5e26d21e [SPARK-42150][K8S][DOCS] Upgrade `Volcano` to 1.7.0 c1a5e26d21e is described below commit c1a5e26d21ec0b985bdcc48cb64c5203a6c79957 Author: Dongjoon Hyun <dongj...@apache.org> AuthorDate: Sat Jan 21 16:35:05 2023 -0800 [SPARK-42150][K8S][DOCS] Upgrade `Volcano` to 1.7.0 ### What changes were proposed in this pull request? This PR aims to upgrade `Volcano` from 1.5.1 to 1.7.0. ### Why are the changes needed? Volcano 1.7.0 finally provides `multi-arch image` and `K8s 1.25`. - https://github.com/volcano-sh/volcano/releases/tag/v1.7.0 ### Does this PR introduce _any_ user-facing change? No. This is a doc-only change. ### How was this patch tested? Manually verify with `Volcano 1.7.0`. ``` $ build/sbt -Psparkr -Pkubernetes -Pvolcano -Pkubernetes-integration-tests -Dtest.exclude.tags=minikube,local -Dtest.include.tags=volcano -Dspark.kubernetes.test.deployMode=docker-desktop "kubernetes-integration-tests/test" ... [info] VolcanoSuite: [info] - Run SparkPi with volcano scheduler (8 seconds, 331 milliseconds) [info] - SPARK-38187: Run SparkPi Jobs with minCPU (30 seconds, 563 milliseconds) [info] - SPARK-38187: Run SparkPi Jobs with minMemory (27 seconds, 505 milliseconds) [info] - SPARK-38188: Run SparkPi jobs with 2 queues (only 1 enabled) (12 seconds, 141 milliseconds) [info] - SPARK-38188: Run SparkPi jobs with 2 queues (all enabled) (21 seconds, 247 milliseconds) [info] - SPARK-38423: Run driver job to validate priority order (21 seconds, 516 milliseconds) [info] YuniKornSuite: [info] Run completed in 2 minutes, 37 seconds. [info] Total number of tests run: 6 [info] Suites: completed 3, aborted 0 [info] Tests: succeeded 6, failed 0, canceled 0, ignored 0, pending 0 [info] All tests passed. [success] Total time: 412 s (06:52), completed Jan 21, 2023, 8:04:01 AM ``` Closes #39690 from dongjoon-hyun/SPARK-42150. Authored-by: Dongjoon Hyun <dongj...@apache.org> Signed-off-by: Dongjoon Hyun <dongj...@apache.org> --- resource-managers/kubernetes/integration-tests/README.md | 16 ++-------------- 1 file changed, 2 insertions(+), 14 deletions(-) diff --git a/resource-managers/kubernetes/integration-tests/README.md b/resource-managers/kubernetes/integration-tests/README.md index 82e4de9bade..c3bce2415e4 100644 --- a/resource-managers/kubernetes/integration-tests/README.md +++ b/resource-managers/kubernetes/integration-tests/README.md @@ -339,11 +339,7 @@ Volcano integration is experimental in Aapche Spark 3.3.0 and the test coverage ## Installation - # x86_64 - kubectl apply -f https://raw.githubusercontent.com/volcano-sh/volcano/v1.5.1/installer/volcano-development.yaml - - # arm64: - kubectl apply -f https://raw.githubusercontent.com/volcano-sh/volcano/v1.5.1/installer/volcano-development-arm64.yaml + kubectl apply -f https://raw.githubusercontent.com/volcano-sh/volcano/v1.7.0/installer/volcano-development.yaml ## Run tests @@ -364,13 +360,5 @@ You can also specify `volcano` tag to only run Volcano test: ## Cleanup Volcano - # x86_64 - kubectl delete -f https://raw.githubusercontent.com/volcano-sh/volcano/v1.5.1/installer/volcano-development.yaml - - # arm64: - kubectl delete -f https://raw.githubusercontent.com/volcano-sh/volcano/v1.5.1/installer/volcano-development-arm64.yaml - - # Cleanup Volcano webhook - kubectl delete validatingwebhookconfigurations volcano-admission-service-jobs-validate volcano-admission-service-pods-validate volcano-admission-service-queues-validate - kubectl delete mutatingwebhookconfigurations volcano-admission-service-jobs-mutate volcano-admission-service-podgroups-mutate volcano-admission-service-pods-mutate volcano-admission-service-queues-mutate + kubectl delete -f https://raw.githubusercontent.com/volcano-sh/volcano/v1.7.0/installer/volcano-development.yaml --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org