This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 63837020ed29 [SPARK-48109][INFRA] Enable `k8s-integration-tests` only
for `kubernetes` module change
63837020ed29 is described below
commit 63837020ed29c9e6003f24117ad21f8b97f40f0f
Author: Dongjoon Hyun <dh...@apple.com>
AuthorDate: Thu May 2 23:21:59 2024 -0700
[SPARK-48109][INFRA] Enable `k8s-integration-tests` only for `kubernetes`
module change
### What changes were proposed in this pull request?
This PR aims to enable `k8s-integration-tests` only for `kubernetes` module
change.
Although there is a chance of missing `core` module change, the daily CI
test coverage will reveal that.
### Why are the changes needed?
To reduce GitHub Action usage to meet ASF INFRA policy.
- https://infra.apache.org/github-actions-policy.html
> The average number of minutes a project uses in any consecutive
five-day period MUST NOT exceed the equivalent of 30 full-time runners (216,000
minutes, or 3,600 hours).
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Manual review.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #46356 from dongjoon-hyun/SPARK-48109.
Authored-by: Dongjoon Hyun <dh...@apple.com>
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
---
.github/workflows/build_and_test.yml | 3 ++-
.github/workflows/build_branch34.yml | 1 +
.github/workflows/build_branch35.yml | 1 +
.github/workflows/build_java21.yml | 3 ++-
4 files changed, 6 insertions(+), 2 deletions(-)
diff --git a/.github/workflows/build_and_test.yml
b/.github/workflows/build_and_test.yml
index 13a05e824f6a..56516c95dcb8 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -82,6 +82,7 @@ jobs:
sparkr=`./dev/is-changed.py -m sparkr`
tpcds=`./dev/is-changed.py -m sql`
docker=`./dev/is-changed.py -m docker-integration-tests`
+ kubernetes=`./dev/is-changed.py -m kubernetes`
# 'build' and 'maven-build' are always true for now.
# It does not save significant time and most of PRs trigger the
build.
precondition="
@@ -93,7 +94,7 @@ jobs:
\"docker-integration-tests\": \"$docker\",
\"maven-build\": \"true\",
\"lint\" : \"true\",
- \"k8s-integration-tests\" : \"true\",
+ \"k8s-integration-tests\" : \"$kubernetes\",
\"buf\" : \"true\",
\"ui\" : \"true\",
}"
diff --git a/.github/workflows/build_branch34.yml
b/.github/workflows/build_branch34.yml
index deb43d82c979..68887970d4d8 100644
--- a/.github/workflows/build_branch34.yml
+++ b/.github/workflows/build_branch34.yml
@@ -47,5 +47,6 @@ jobs:
"sparkr": "true",
"tpcds-1g": "true",
"docker-integration-tests": "true",
+ "k8s-integration-tests": "true",
"lint" : "true"
}
diff --git a/.github/workflows/build_branch35.yml
b/.github/workflows/build_branch35.yml
index 9e6fe13c020e..55616c2f1f01 100644
--- a/.github/workflows/build_branch35.yml
+++ b/.github/workflows/build_branch35.yml
@@ -47,5 +47,6 @@ jobs:
"sparkr": "true",
"tpcds-1g": "true",
"docker-integration-tests": "true",
+ "k8s-integration-tests": "true",
"lint" : "true"
}
diff --git a/.github/workflows/build_java21.yml
b/.github/workflows/build_java21.yml
index b1ef5a321835..bfeedd4174cf 100644
--- a/.github/workflows/build_java21.yml
+++ b/.github/workflows/build_java21.yml
@@ -46,5 +46,6 @@ jobs:
"pyspark": "true",
"sparkr": "true",
"tpcds-1g": "true",
- "docker-integration-tests": "true"
+ "docker-integration-tests": "true",
+ "k8s-integration-tests": "true"
}
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
