jason810496 opened a new pull request, #71813:
URL: https://github.com/apache/airflow/pull/71813
Draft. Holds the work carved out of #71704 so nothing is lost while that PR
is reduced to the minimal, cherry-pickable scheduler fix.
related: #71704
## Why this exists
#71704 originally bundled four separable things. Per review feedback there,
it now ships only the scheduler cache bound — one line, no new configuration,
no `DBDagBag` API change — so it can be cherry-picked cleanly. This branch
carries the rest.
## What is still here
- **`[api] dag_cache_size = 0` silently ignored `[api] dag_cache_ttl`.**
Selecting "no size limit" also disabled TTL eviction, so TTL could not be
enabled without also accepting a size cap. A pre-existing bug in shipped
behaviour, and backportable on its own.
- **`DBDagBag` gains `stats_prefix`,** so each component reports cache
activity under its own metric namespace instead of every caller emitting
`api_server.dag_bag.*`. The minimal fix in #71704 leaves the scheduler
reporting under the API server's names; this is what corrects that.
- **`[scheduler] dag_cache_size` / `dag_cache_ttl`,** making the bound
introduced in #71704 tunable, plus the `[api]` option docs and their
`version_added` correction (3.3.0 was wrong; those options shipped in 3.2.2).
- **Metrics registry check matches dynamic names by their static parts,** so
a `{variable}` can sit anywhere in a metric name rather than only after a fixed
prefix. Supersedes #71276.
## Planned split
This is not intended to merge as one PR. It will be split into at least:
1. the `[api]` TTL bugfix, targeted for backport;
2. the `stats_prefix` / metric-namespace change plus the registry check;
3. the new `[scheduler]` configuration, for a minor release.
Kept as a single draft for now so the deferred work is reviewable in one
place and visibly not dropped.
## Note
Branched before #71704 was reduced, so it needs rebasing onto current `main`
before any of the above is split out for real review.
---
##### Was generative AI tooling used to co-author this PR?
- [x] Yes — Claude Code (Opus 5)
Generated-by: Claude Code (Opus 5) following [the
guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#gen-ai-assisted-contributions)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
