This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.5 by this push:
new 15b5d2a55837 [SPARK-48178][INFRA][3.5] Run
`build/scala-213/java-11-17` jobs of `branch-3.5` only if needed
15b5d2a55837 is described below
commit 15b5d2a558371395547461d7b37f20610432dea0
Author: Dongjoon Hyun <dh...@apple.com>
AuthorDate: Tue May 7 15:54:50 2024 -0700
[SPARK-48178][INFRA][3.5] Run `build/scala-213/java-11-17` jobs of
`branch-3.5` only if needed
### What changes were proposed in this pull request?
This PR aims to run `build`, `scala-213`, and `java-11-17` job of
`branch-3.5` only if needed to reduce the maximum concurrency of Apache Spark
GitHub Action usage.
### Why are the changes needed?
To meet ASF Infra GitHub Action policy, we need to reduce the maximum
concurrency.
- https://infra.apache.org/github-actions-policy.html
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #46449 from dongjoon-hyun/SPARK-48178.
Authored-by: Dongjoon Hyun <dh...@apple.com>
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
---
.github/workflows/build_and_test.yml | 9 ++++-----
1 file changed, 4 insertions(+), 5 deletions(-)
diff --git a/.github/workflows/build_and_test.yml
b/.github/workflows/build_and_test.yml
index fa40b2d0a390..9c3dc95d0f66 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -85,17 +85,16 @@ jobs:
sparkr=`./dev/is-changed.py -m sparkr`
tpcds=`./dev/is-changed.py -m sql`
docker=`./dev/is-changed.py -m docker-integration-tests`
- # 'build', 'scala-213', and 'java-11-17' are always true for now.
- # It does not save significant time and most of PRs trigger the
build.
+ build=`./dev/is-changed.py -m
"core,unsafe,kvstore,avro,utils,network-common,network-shuffle,repl,launcher,examples,sketch,graphx,catalyst,hive-thriftserver,streaming,sql-kafka-0-10,streaming-kafka-0-10,mllib-local,mllib,yarn,mesos,kubernetes,hadoop-cloud,spark-ganglia-lgpl,sql,hive"`
precondition="
{
- \"build\": \"true\",
+ \"build\": \"$build\",
\"pyspark\": \"$pyspark\",
\"sparkr\": \"$sparkr\",
\"tpcds-1g\": \"$tpcds\",
\"docker-integration-tests\": \"$docker\",
- \"scala-213\": \"true\",
- \"java-11-17\": \"true\",
+ \"scala-213\": \"$build\",
+ \"java-11-17\": \"$build\",
\"lint\" : \"true\",
\"k8s-integration-tests\" : \"true\",
\"breaking-changes-buf\" : \"true\",
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
