kumarUjjawal opened a new pull request, #25249:
URL: https://github.com/apache/datafusion/pull/25249

   ## Which issue does this PR close?
   
   Part of #25148.
   
   ## Rationale for this change
   
   The DataFusion and Substrait feature checks wait for the workspace check, 
but start on separate runners and restore a cache intended for test builds. 
Sharing the workspace check's outputs can avoid repeating compatible 
compilation work within the same workflow run, including on a cold PR run.
   
   ## What changes are included in this PR?
   
   - Upload the workspace build outputs and Cargo registry once from 
`linux-build-lib`, then restore them in the DataFusion and Substrait 
feature-check jobs.
   - Include tracked source files in the archive to preserve timestamps, and 
use tar archives to preserve Cargo's hidden fingerprint files and executable 
permissions.
   - Keep the producer's dependency cache, retain artifacts for one day, 
support reruns, and run the checks normally if artifacts cannot be uploaded or 
downloaded.
   - Preserve every existing check command, runner, trigger, job name, and job 
dependency.
   
   This starts with two feature-check jobs. The PR is a draft while CI 
measurements establish artifact size, transfer overhead, and compilation reuse; 
no net performance improvement is claimed yet.
   
   ## What is the testing strategy for this PR?
   
   - The exact archive and restore commands passed a temporary Cargo workspace 
test: all four consumer artifacts were fresh after a simulated fresh checkout, 
including a dependency with a build script. A feature change triggered 
compilation, and a later source error was detected.
   - Before/after workflow comparison confirmed that all 26 jobs retain their 
existing check commands, runners, triggers, and dependencies.
   - Actionlint passed for the complete producer and two consumer jobs; the 
required-status-check validator, workflow tool-install check, spelling check, 
and `git diff --check` passed.
   - Hosted CI will validate the actual DataFusion checks and provide transfer 
and compilation timings.
   
   ## Are there any user-facing changes?
   
   No.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to