FenjuFu opened a new pull request, #11836:
URL: https://github.com/apache/seatunnel/pull/11836

   ### Purpose of this pull request
   
   Closes the first, publishable slice of #11638.
   
   This PR moves the shared Spark E2E image build path into the SeaTunnel 
repository:
   
   - adds one Apache-licensed Docker build context for Spark 2.4.6 and 3.3.0;
   - builds both tags for `linux/amd64` and `linux/arm64` with Docker Buildx 
bake;
   - verifies the downloaded Spark archives against the SHA-512 values 
published by Apache;
   - adds a pull-request build that needs no registry credentials;
   - adds a manual, Apache-repository-only publish path for 
`apache/seatunnel:e2e-spark-2.4.6` and `apache/seatunnel:e2e-spark-3.3.0`.
   
   The existing `tyrantlucifer/spark` Java references intentionally remain 
unchanged in this PR. GitHub only allows a manually dispatched workflow after 
the workflow exists on the default branch, so switching those references in the 
same PR would make CI and users pull tags that have not been published yet. 
After a maintainer dispatches this workflow once and the project-owned tags 
exist, a focused follow-up can switch `Spark2Container` and `Spark3Container`. 
The Flink 1.13-1.18/1.20 images remain follow-up work, as discussed in #11638.
   
   ### Does this PR introduce _any_ user-facing change?
   
   No. It adds E2E image build and publishing infrastructure only.
   
   ### How was this patch tested?
   
   - `go run github.com/rhysd/actionlint/cmd/[email protected] 
.github/workflows/publish-e2e-spark-images.yaml`
   - `JAVA_HOME=<Temurin 8> ./mvnw -pl seatunnel-e2e/seatunnel-e2e-common 
spotless:apply`
   - `git diff --check`
   - confirmed both Apache Spark archive URLs return HTTP 200;
   - confirmed `eclipse-temurin:8-jre-jammy` resolves for both `linux/amd64` 
and `linux/arm64` with `crane digest`;
   - copied both SHA-512 values from the corresponding files on 
`archive.apache.org`.
   
   A full `./mvnw -q -DskipTests verify` retry and a targeted 
`seatunnel-e2e-common -am` verify emitted no build errors but did not complete 
within the local Windows 15-minute and 10-minute limits, respectively. Docker 
is not installed on this host, so the new credential-free PR workflow is the 
authoritative multi-architecture build check.
   
   ### Check list
   
   * [x] No new Jar binary package is added.
   * [x] No user documentation update is necessary for this internal E2E build 
path.
   * [x] No incompatible change is introduced.
   * [x] This PR does not add or modify connector code.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to