FrankYang0529 commented on PR #76279:
URL: https://github.com/apache/airflow/pull/76279#issuecomment-6631752395

   Thanks for narrowing this down. I ran the check you suggested on the "Build 
CI image" jobs.
   
   - The four cards at the top of the metrics page count every job in the 
repository, and the "Build CI image" filter only changes the table under the 
tabs.
   - From 2026-09-01 to 2026-09-30, 34 of 7,257 jobs failed. From 2026-10-02 to 
2026-11-03, 133 of 8,897 jobs failed. None of the 167 failures happened while 
zstd was running. The export step, which runs zstd, failed in 4 jobs. These 4 
jobs are among the 13 jobs that the table counts as Spot interruptions. In each 
of these 4 jobs, AWS interrupted the Spot instance during `docker image save`, 
before zstd started. In the other 9 of the 13 jobs, AWS interrupted the Spot 
instance during a different step.
   
   | Cause | 2026-09-01 to 09-30 | 2026-10-02 to 11-03 |
   |---|---:|---:|
   | `install_os_dependencies.sh` failed, mostly in apt (held broken packages, 
or 403 from dhi.io) | 2 | 40 |
   | Docker Hub returned 429 or 5xx, or could not be reached | 2 | 26 |
   | Installing or checking the Python packages failed (uv or pip) | 17 | 21 |
   | The download of mprocs failed | 4 | 14 |
   | AWS interrupted the EC2 Spot instance (RunsOn) | 0 | 13 |
   | Other, such as a failed stash upload or a base image missing on ghcr.io | 
9 | 19 |
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to