zachliu opened a new issue, #49800: URL: https://github.com/apache/airflow/issues/49800
### Apache Airflow version 3.0.0 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? When a DAG has too many past runs (e.g., an hourly DAG that has been running continuously for a year), the UI fails to load the grid view and returns a `504 Gateway Timeout`, even though the request specifies `limit=10`. I don't have an exact number to define "many past runs". But my Airflow 3 failed to load the grid view for a DAG that has over `8,000` DAG runs. After deleting ~`5,000` DAG runs from the database (sadly searching & deleting DAG runs is removed from the UI in Airflow 3), the UI is able load the grid view but with a significant delay of `49.21s` ### What you think should happen instead? With the proper limit, grid view should load pretty fast without `504 Gateway Timeout`. ### How to reproduce Create a "minutely" dag to accumulate a few thousands of DAG runs and try to load the grid view ### Operating System LM 21.3 with docker python:3.12-slim-bookworm ### Versions of Apache Airflow Providers _No response_ ### Deployment Other Docker-based deployment ### Deployment details _No response_ ### Anything else? _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
