This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push: new a0f62393d69a [SPARK-48132][INFRA] Run `k8s-integration-tests` only in PR builder and Daily CIs a0f62393d69a is described below commit a0f62393d69a40ddd49b034b3ce332e6fa6bfb13 Author: Dongjoon Hyun <dh...@apple.com> AuthorDate: Sat May 4 22:55:04 2024 -0700 [SPARK-48132][INFRA] Run `k8s-integration-tests` only in PR builder and Daily CIs ### What changes were proposed in this pull request? This PR aims to run `k8s-integration-tests` only in PR builder and Daily Python CIs. In other words, only the commit builder will skip it by default. Please note that - K8s unit tests will be covered by the commit builder still. - All PR builders are not consuming ASF resources and they provide lots of test coverage everyday also. ### Why are the changes needed? To reduce GitHub Action usage to meet ASF INFRA policy. - https://infra.apache.org/github-actions-policy.html > All workflows MUST have a job concurrency level less than or equal to 20. This means a workflow cannot have more than 20 jobs running at the same time across all matrices. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Manual review. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #46388 from dongjoon-hyun/SPARK-48132. Authored-by: Dongjoon Hyun <dh...@apple.com> Signed-off-by: Dongjoon Hyun <dh...@apple.com> --- .github/workflows/build_and_test.yml | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/.github/workflows/build_and_test.yml b/.github/workflows/build_and_test.yml index 6ef971002c54..c87e8921b48e 100644 --- a/.github/workflows/build_and_test.yml +++ b/.github/workflows/build_and_test.yml @@ -81,11 +81,12 @@ jobs: pyspark=`./dev/is-changed.py -m $pyspark_modules` if [[ "${{ github.repository }}" != 'apache/spark' ]]; then pandas=$pyspark + kubernetes=`./dev/is-changed.py -m kubernetes` else pandas=false + kubernetes=false fi sparkr=`./dev/is-changed.py -m sparkr` - kubernetes=`./dev/is-changed.py -m kubernetes` # 'build' is always true for now. # It does not save significant time and most of PRs trigger the build. precondition=" --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org