kaxil commented on issue #16439: URL: https://github.com/apache/airflow/issues/16439#issuecomment-861025342
Restarting Airflow scheduler does not remove the old Metadata. That metadata about historical DagRuns and Task instances is stored in Airflow Metadata DB (Postgres, MySQL etc) as shown in https://airflow.apache.org/docs/apache-airflow/stable/concepts/overview.html You should use a managed DB service like Cloud SQL or AWS RDS and not use ephemeral storage like Postgres in Kubernetes Pod etc. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org