GitHub user Komalpawar22 added a comment to the discussion: Airflow 2.10.4 is significantly slower compared to 2.9.3
Hi @potiuk, My observation over time is that DAGs with fewer tasks are running fast, whereas I am specifically referring to a DAG with 3000+ tasks, and this number may increase in the future. How can we improve performance in this case? What do you think could be the possible reasons for this slowdown? Understanding this will help me debug the issue in more depth and provide direction on where to focus my investigation. GitHub link: https://github.com/apache/airflow/discussions/46552#discussioncomment-12636013 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
