[ https://issues.apache.org/jira/browse/AIRFLOW-108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Riccomini updated AIRFLOW-108: ------------------------------------ Issue Type: Wish (was: New Feature) Summary: Add data retention policy to Airflow (was: Add data retention to Airflow) > Add data retention policy to Airflow > ------------------------------------ > > Key: AIRFLOW-108 > URL: https://issues.apache.org/jira/browse/AIRFLOW-108 > Project: Apache Airflow > Issue Type: Wish > Components: db, scheduler > Reporter: Chris Riccomini > > Airflow's DB currently holds the entire history of all executions for all > time. This is problematic as the DB grows. The UI starts to get slower, and > the DB's disk usage grows. There is no bound to how large the DB will grow. > It would be useful to add a feature in Airflow to do two things: > # Delete old data from the DB > # Mark some lower watermark, past which DAG executions are ignored > For example, (2) would allow you to tell the scheduler "ignore all data prior > to a year ago". And (1) would allow Airflow to delete all data prior to > January 1, 2015. -- This message was sent by Atlassian JIRA (v6.3.4#6332)