GitHub user potiuk added a comment to the discussion: [Memory Leak] Memory usage scales linearly and does not release after DAG execution in webserver(High), celery and scheduler
I think you can chime in in the PR here https://github.com/apache/airflow/pull/60804 -> there are some changes that will address ever-growing memory of the api-server. For now you can easily workaround it by configuring your deployment to have multiple api-servers and gracefully shutting eah of them down periodically. Api-servers are stateless, so you can have more of them and have load-balancing in front and restart some of the servers while others will be serving traffic. With the PR and other changs discussed we are likely to have it easier/more automated, but for now you have to handle it on your own. GitHub link: https://github.com/apache/airflow/discussions/61684#discussioncomment-15769238 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
