The GitHub Actions job "Tests (AMD)" on airflow.git/scheduler-batch-dag-version-resolution has failed. Run started by GitHub user steveahnahn (triggered by steveahnahn).
Head commit for run: fb0c38951b98332acfaa55bc3d047cb37fb3be52 / Steve Ahn <[email protected]> Resolve dag versions once per scheduler loop instead of once per dag run Each scheduling loop resolved the dag for every dag run individually, issuing one latest-version lookup per run per tick — and twice per run in the main scheduling loop, where the integrity check repeated the same lookup. The two loops that attempted to amortize this keyed an lru_cache on the DagRun instance, which appears exactly once per loop, so that cache never produced a hit. At the default per-loop caps this wastes dozens of point queries per scheduler tick in every deployment, adding database load and scheduling latency that grow with the number of runs examined. Resolve the latest versions for the whole batch in one query and share the result between dag resolution and the integrity check. Report URL: https://github.com/apache/airflow/actions/runs/31230666082 With regards, GitHub Actions via GitBox --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
