rehan243 commented on issue #68693: URL: https://github.com/apache/airflow/issues/68693#issuecomment-4745885642
Hm, interesting you’re running with `worker_refresh_interval=0` — that definitely keeps the Manager attached longer, so the leak stabilizes. Yeah, that version thing can be tricky. We saw similar behavior on v2.x, but I think in v3 they fixed some of the process reaping stuff? Might be worth double-checking your Airflow version. Lmk if you want a pointer on the specific PRs or configs we used to mitigate this at scale. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
