dheerajturaga commented on code in PR #64326:
URL: https://github.com/apache/airflow/pull/64326#discussion_r3002703485
##########
airflow-core/src/airflow/config_templates/config.yml:
##########
@@ -517,6 +517,17 @@ core:
type: boolean
example: ~
default: "False"
+ max_dag_version_cache_size:
+ description: |
+ Maximum number of DAG versions to keep in the in-memory cache used by
DBDagBag.
+ When the limit is reached the least-recently-used version is evicted.
Increase this
+ value if you have many concurrently active DAG versions and can afford
the memory;
+ decrease it to reduce the memory footprint of long-running API server
or scheduler
+ processes.
+ version_added: 3.1.0
Review Comment:
@vatsrahul1001, This is critical enough for 3.2.0 IMO. Im, having to restart
my servers every week to stay in bounds of memory
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
