The GitHub Actions job "Tests (AMD)" on 
airflow.git/fix/scheduler/dbdagbag-unbounded-cache has failed.
Run started by GitHub user jason810496 (triggered by jason810496).

Head commit for run:
522a76de3d77625d8973af3cbdf89e9172eabe83 / LIU ZHE YOU <[email protected]>
Bound the scheduler's Dag cache and honor TTL without a size cap

The scheduler cached deserialized Dags in a dict that never evicted, so every
Dag version it had ever seen stayed resident and the process was eventually
OOM killed.

``[api] dag_cache_size = 0`` had a related gap: it selected that same
never-evicting dict and silently ignored ``[api] dag_cache_ttl``, so TTL
eviction could not be enabled without also accepting a size limit.

Each re-check resets a cached entry's expiry, so the TTL reclaims a version
once its Dag runs finish and it stops being requested; ``dag_cache_size``
remains the only hard ceiling.

closes: #69001

Report URL: https://github.com/apache/airflow/actions/runs/32036041334

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to