sjyangkevin commented on PR #76957: URL: https://github.com/apache/airflow/pull/76957#issuecomment-6834610269
### End-to-end run of the new job in my own fork Project CI for this PR is waiting for workflow approval, so I ran the full `Tests (AMD)` workflow in my fork to check the new job end to end. - **Run:** https://github.com/sjyangkevin/airflow/actions/runs/43285082976 - **Commit tested:** `19170e7d23`, the current head of this PR (push event, public GitHub runners) - **Branch tip tested:** `v3-4-test` at `5aac527431`, which was the tip of `apache/airflow` `v3-4-test` during the run (2026-11-12) #### What the run shows | Step | Evidence in the log | Where | |---|---|---| | Selective checks turn the job on | `run-providers-branch-tip-compatibility-tests = true`, latest release `3.4.0` | [Build info, "Selective checks"](https://github.com/sjyangkevin/airflow/actions/runs/43285082976/job/131416728076#step:10:1) | | The release branch tip is resolved | `v3-4-test: 5aac527431c2e6610384bfa09073897f29cd1071` | [Find release branch tips](https://github.com/sjyangkevin/airflow/actions/runs/43285082976/job/131423531159#step:2:1) | | Airflow is built from that commit, with the compiled UI | `git_version of the airflow-core wheel: .release:5aac527431c2e6610384bfa09073897f29cd1071` | [Build Airflow from v3-4-test](https://github.com/sjyangkevin/airflow/actions/runs/43285082976/job/131426161567#step:6:1) | | The tests install that build, not 3.4.0 from PyPI | `Installed apache-airflow-core 3.4.0 git_version: .release:5aac527431c2e6610384bfa09073897f29cd1071` | [Compat v3-4-test, "Check that Airflow installed from the wheels…"](https://github.com/sjyangkevin/airflow/actions/runs/43285082976/job/131431170820#step:11:1) | | Provider unit tests pass on the branch tip | All five test groups OK: 33,683 passed, 608 skipped, 0 failed | [Compat v3-4-test, "Run provider unit tests…"](https://github.com/sjyangkevin/airflow/actions/runs/43285082976/job/131431170820#step:12:1) | | Same result as the released version | Compat 3.4.0 in the same run: identical counts in every group | [Compat 3.4.0](https://github.com/sjyangkevin/airflow/actions/runs/43285082976/job/131423530398#step:12:1) | The branch tip and the 3.4.0 wheel have the same version number, so the fourth row is what tells them apart. That check is new in this PR since the first push: the job now fails if the installed Airflow was not built from the resolved commit. <img width="1625" height="626" alt="Screenshot from 2026-11-12 15-03-44" src="https://github.com/user-attachments/assets/96d3b84c-c2fa-460b-b2c5-14ad37554439"; /> <img width="1625" height="626" alt="Screenshot from 2026-11-12 15-04-06" src="https://github.com/user-attachments/assets/43f19935-b2fc-410f-87d4-515e8f743360"; /> <img width="1625" height="626" alt="Screenshot from 2026-11-12 15-04-38" src="https://github.com/user-attachments/assets/eaada87c-d23d-4167-8f84-f6cf8b86e59a"; /> <img width="1624" height="782" alt="Screenshot from 2026-11-12 15-05-16" src="https://github.com/user-attachments/assets/2f17742b-2c50-4150-8fbd-f7cc65bbc82c"; /> #### What this run does not show - **It is a fork run, not project CI.** It used public runners and my fork's caches. - **I pushed copies of `v3-4-test` and `constraints-3-4` to my fork first.** The job reads the release branches, the commit and the constraints from the repository it runs in. In a fork without those branches it finds no target and passes without testing anything. - **A green run shows the job works, not that it catches a break.** The negative control for that is the local run in the PR description. #### One question Should the job always read the branch tips from `apache/airflow`, the way #75632 did for provider release tags? Then a run in a contributor's fork would test the real branch tip instead of whatever copy the fork has. I kept it on the running repository for now and can change it here if that is preferred. #### Changes since the first push - The scripts test that lists the jobs selecting prek hooks did not include the new job. Fixed. - Added the installed-version check described above. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
