This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.4 by this push:
new d16a4f4c98d5 [SPARK-48207][INFRA][3.4] Run
`build/scala-213/java-11-17` jobs of `branch-3.4` only if needed
d16a4f4c98d5 is described below
commit d16a4f4c98d5e6a44ff783e20a9f2f2f80c009f3
Author: Dongjoon Hyun <dh...@apple.com>
AuthorDate: Wed May 8 16:19:40 2024 -0700
[SPARK-48207][INFRA][3.4] Run `build/scala-213/java-11-17` jobs of
`branch-3.4` only if needed
### What changes were proposed in this pull request?
This PR aims to run `build`, `scala-213`, and `java-11-17` job of
`branch-3.4` only if needed to reduce the maximum concurrency of Apache Spark
GitHub Action usage.
### Why are the changes needed?
To meet ASF Infra GitHub Action policy, we need to reduce the maximum
concurrency.
- https://infra.apache.org/github-actions-policy.html
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #46489 from dongjoon-hyun/SPARK-48207.
Authored-by: Dongjoon Hyun <dh...@apple.com>
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
---
.github/workflows/build_and_test.yml | 9 ++++-----
1 file changed, 4 insertions(+), 5 deletions(-)
diff --git a/.github/workflows/build_and_test.yml
b/.github/workflows/build_and_test.yml
index 64f18b5163b1..3e44d6cfd179 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -98,18 +98,17 @@ jobs:
tpcds=false
docker=false
fi
- # 'build', 'scala-213', and 'java-11-17' are always true for now.
- # It does not save significant time and most of PRs trigger the
build.
+ build=`./dev/is-changed.py -m
"core,unsafe,kvstore,avro,network-common,network-shuffle,repl,launcher,examples,sketch,graphx,catalyst,hive-thriftserver,streaming,sql-kafka-0-10,streaming-kafka-0-10,mllib-local,mllib,yarn,mesos,kubernetes,hadoop-cloud,spark-ganglia-lgpl,connect,protobuf"`
precondition="
{
- \"build\": \"true\",
+ \"build\": \"$build\",
\"pyspark\": \"$pyspark\",
\"pyspark-pandas\": \"$pandas\",
\"sparkr\": \"$sparkr\",
\"tpcds-1g\": \"$tpcds\",
\"docker-integration-tests\": \"$docker\",
- \"scala-213\": \"true\",
- \"java-11-17\": \"true\",
+ \"scala-213\": \"$build\",
+ \"java-11-17\": \"$build\",
\"lint\" : \"true\",
\"k8s-integration-tests\" : \"$kubernetes\",
}"
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
