This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.4 by this push:
new 4b032a18924b [SPARK-48132][INFRA] Run `k8s-integration-tests` only in
PR builder and Daily CIs
4b032a18924b is described below
commit 4b032a18924bd35322570551448c643786fd1a98
Author: Dongjoon Hyun <dh...@apple.com>
AuthorDate: Sat May 4 22:55:04 2024 -0700
[SPARK-48132][INFRA] Run `k8s-integration-tests` only in PR builder and
Daily CIs
This PR aims to run `k8s-integration-tests` only in PR builder and Daily
Python CIs. In other words, only the commit builder will skip it by default.
Please note that
- K8s unit tests will be covered by the commit builder still.
- All PR builders are not consuming ASF resources and they provide lots of
test coverage everyday also.
To reduce GitHub Action usage to meet ASF INFRA policy.
- https://infra.apache.org/github-actions-policy.html
> All workflows MUST have a job concurrency level less than or equal to
20. This means a workflow cannot have more than 20 jobs running at the same
time across all matrices.
No.
Manual review.
No.
Closes #46388 from dongjoon-hyun/SPARK-48132.
Authored-by: Dongjoon Hyun <dh...@apple.com>
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
(cherry picked from commit 9454607944df5e8430642bbe399a35436506be2a)
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
---
.github/workflows/build_and_test.yml | 4 +++-
1 file changed, 3 insertions(+), 1 deletion(-)
diff --git a/.github/workflows/build_and_test.yml
b/.github/workflows/build_and_test.yml
index 35c1328256c2..cf1eb7b4c233 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -90,8 +90,10 @@ jobs:
fi
if [[ "${{ github.repository }}" != 'apache/spark' ]]; then
pandas=$pyspark
+ kubernetes=`./dev/is-changed.py -m kubernetes`
else
pandas=false
+ kubernetes=false
fi
# 'build', 'scala-213', and 'java-11-17' are always true for now.
# It does not save significant time and most of PRs trigger the
build.
@@ -106,7 +108,7 @@ jobs:
\"scala-213\": \"true\",
\"java-11-17\": \"true\",
\"lint\" : \"true\",
- \"k8s-integration-tests\" : \"true\",
+ \"k8s-integration-tests\" : \"$kubernetes\",
}"
echo $precondition # For debugging
# Remove `\n` to avoid "Invalid format" error
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
