This is an automated email from the ASF dual-hosted git repository.
yao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new af70aafd330f [SPARK-49154][K8S][INFRA][DOCS] Upgrade `Volcano` to 1.9.0
af70aafd330f is described below
commit af70aafd330fdbb6ce0d5b3efbcb180cda488695
Author: Dongjoon Hyun <dh...@apple.com>
AuthorDate: Thu Aug 8 14:25:04 2024 +0800
[SPARK-49154][K8S][INFRA][DOCS] Upgrade `Volcano` to 1.9.0
### What changes were proposed in this pull request?
This PR aims to upgrade `Volcano` in K8s integration test document and
GitHub Action job.
### Why are the changes needed?
To bring the latest bug fixes in addition to the test coverage for Volcano
scheduler 1.9.0.
- https://github.com/volcano-sh/volcano/releases/tag/v1.9.0
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #47661 from dongjoon-hyun/SPARK-49154.
Authored-by: Dongjoon Hyun <dh...@apple.com>
Signed-off-by: Kent Yao <y...@apache.org>
---
.github/workflows/build_and_test.yml | 3 +--
resource-managers/kubernetes/integration-tests/README.md | 6 +++---
2 files changed, 4 insertions(+), 5 deletions(-)
diff --git a/.github/workflows/build_and_test.yml
b/.github/workflows/build_and_test.yml
index 2473e9ad7fa3..0003e23d7dc1 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -1126,11 +1126,10 @@ jobs:
export PVC_TESTS_VM_PATH=$PVC_TMP_DIR
minikube mount ${PVC_TESTS_HOST_PATH}:${PVC_TESTS_VM_PATH} --gid=0
--uid=185 &
kubectl create clusterrolebinding serviceaccounts-cluster-admin
--clusterrole=cluster-admin --group=system:serviceaccounts || true
- kubectl apply -f
https://raw.githubusercontent.com/volcano-sh/volcano/v1.8.2/installer/volcano-development.yaml
|| true
if [[ "${{ inputs.branch }}" == 'branch-3.5' || "${{ inputs.branch
}}" == 'branch-3.4' ]]; then
kubectl apply -f
https://raw.githubusercontent.com/volcano-sh/volcano/v1.7.0/installer/volcano-development.yaml
|| true
else
- kubectl apply -f
https://raw.githubusercontent.com/volcano-sh/volcano/v1.8.2/installer/volcano-development.yaml
|| true
+ kubectl apply -f
https://raw.githubusercontent.com/volcano-sh/volcano/v1.9.0/installer/volcano-development.yaml
|| true
fi
eval $(minikube docker-env)
build/sbt -Phadoop-3 -Psparkr -Pkubernetes -Pvolcano
-Pkubernetes-integration-tests
-Dspark.kubernetes.test.volcanoMaxConcurrencyJobNum=1 -Dtest.exclude.tags=local
"kubernetes-integration-tests/test"
diff --git a/resource-managers/kubernetes/integration-tests/README.md
b/resource-managers/kubernetes/integration-tests/README.md
index f8070ec4ce93..5b80fe10596c 100644
--- a/resource-managers/kubernetes/integration-tests/README.md
+++ b/resource-managers/kubernetes/integration-tests/README.md
@@ -330,11 +330,11 @@ You can also specify your specific dockerfile to build
JVM/Python/R based image
## Requirements
- A minimum of 6 CPUs and 9G of memory is required to complete all Volcano
test cases.
-- Volcano v1.8.2.
+- Volcano v1.9.0.
## Installation
- kubectl apply -f
https://raw.githubusercontent.com/volcano-sh/volcano/v1.8.2/installer/volcano-development.yaml
+ kubectl apply -f
https://raw.githubusercontent.com/volcano-sh/volcano/v1.9.0/installer/volcano-development.yaml
## Run tests
@@ -355,5 +355,5 @@ You can also specify `volcano` tag to only run Volcano test:
## Cleanup Volcano
- kubectl delete -f
https://raw.githubusercontent.com/volcano-sh/volcano/v1.8.2/installer/volcano-development.yaml
+ kubectl delete -f
https://raw.githubusercontent.com/volcano-sh/volcano/v1.9.0/installer/volcano-development.yaml
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
