This is an automated email from the ASF dual-hosted git repository.
chengpan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/kyuubi.git
The following commit(s) were added to refs/heads/master by this push:
new e3c213b3dc [KYUUBI #7194] Speed up K8s integration tests in CI
e3c213b3dc is described below
commit e3c213b3dc70debdd39d1b8a2774f24c8a85d3ab
Author: Cheng Pan <[email protected]>
AuthorDate: Sat Sep 6 22:57:01 2025 +0800
[KYUUBI #7194] Speed up K8s integration tests in CI
### Why are the changes needed?
Use `apache/spark:3.5.5` as the Kyuubi image's base image to avoid
downloading Spark tgz inside the image building phase.
### How was this patch tested?
Monitor CI.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #7194 from pan3793/k8s-it.
Closes #7194
78482a897 [Cheng Pan] Update .github/workflows/master.yml
32e2ca7d5 [Cheng Pan] Speed up K8s integration tests in CI
Authored-by: Cheng Pan <[email protected]>
Signed-off-by: Cheng Pan <[email protected]>
---
.github/workflows/master.yml | 11 +++++++----
.../kyuubi-kubernetes-it/src/test/resources/driver.yml | 2 +-
.../src/test/resources/kyuubi-server.yaml | 2 +-
3 files changed, 9 insertions(+), 6 deletions(-)
diff --git a/.github/workflows/master.yml b/.github/workflows/master.yml
index 4044356a86..afa747e069 100644
--- a/.github/workflows/master.yml
+++ b/.github/workflows/master.yml
@@ -422,17 +422,21 @@ jobs:
uses: docker/setup-buildx-action@v3
with:
cache-binary: false
+ - name: Pull Spark image
+ run: |
+ docker pull apache/spark:3.5.5
- name: Build Kyuubi Docker Image
uses: docker/build-push-action@v6
with:
# passthrough CI into build container
build-args: |
CI=${CI}
- MVN_ARG=--flink-provided --hive-provided
+ BASE_IMAGE=apache/spark:3.5.5
+ MVN_ARG=--spark-provided --flink-provided --hive-provided
context: .
file: build/Dockerfile.CI
load: true
- tags: apache/kyuubi:latest
+ tags: apache/kyuubi:ci
- name: Cache Engine Archives
uses: ./.github/actions/cache-engine-archives
- name: Setup Minikube
@@ -442,9 +446,8 @@ jobs:
sudo install minikube-linux-amd64 /usr/local/bin/minikube
minikube start --cpus 2 --memory 4096
--kubernetes-version=${KUBERNETES_VERSION} --force
#
https://minikube.sigs.k8s.io/docs/handbook/pushing/#7-loading-directly-to-in-cluster-container-runtime
- minikube image load apache/kyuubi:latest
+ minikube image load apache/kyuubi:ci
# pre-install spark into minikube
- docker pull apache/spark:3.5.5
minikube image load apache/spark:3.5.5
- name: kubectl pre-check
run: |
diff --git
a/integration-tests/kyuubi-kubernetes-it/src/test/resources/driver.yml
b/integration-tests/kyuubi-kubernetes-it/src/test/resources/driver.yml
index c717352244..d890496286 100644
--- a/integration-tests/kyuubi-kubernetes-it/src/test/resources/driver.yml
+++ b/integration-tests/kyuubi-kubernetes-it/src/test/resources/driver.yml
@@ -15,7 +15,7 @@
# limitations under the License.
#
-apiVersio: v1
+apiVersion: v1
kind: Pod
metadata:
name: driver
diff --git
a/integration-tests/kyuubi-kubernetes-it/src/test/resources/kyuubi-server.yaml
b/integration-tests/kyuubi-kubernetes-it/src/test/resources/kyuubi-server.yaml
index 5962f80710..56966f2ce9 100644
---
a/integration-tests/kyuubi-kubernetes-it/src/test/resources/kyuubi-server.yaml
+++
b/integration-tests/kyuubi-kubernetes-it/src/test/resources/kyuubi-server.yaml
@@ -25,7 +25,7 @@ spec:
serviceAccountName: kyuubi
containers:
- name: kyuubi-server
- image: apache/kyuubi:latest
+ image: apache/kyuubi:ci
imagePullPolicy: IfNotPresent
env:
- name: KYUUBI_JAVA_OPTS
