GitHub user michaelosthege added a comment to the discussion: High CPU and 
database load caused by Airflow 3 dag-processor and scheduler

At 15s idle sleep, all 2 DAGs disabled, and only the PostgreSQL and scheduler 
running, I get about 30 transactions per second. In my setup this creates 25 % 
CPU load from the PostgreSQL container compared to ~2.6 % under Airflow 2.9.0 
with webserver, scheduler and DAGs turned on 😮

The corresponding flame graph shows <5 % time spent in `time.sleep`.

<details><summary>👀 yet another flame graph</summary>

![scheduler_idle](https://github.com/user-attachments/assets/f51507a4-833c-411d-ad64-6bb61fc96692)

</details>

GitHub link: 
https://github.com/apache/airflow/discussions/53177#discussioncomment-13735074

----
This is an automatically sent email for commits@airflow.apache.org.
To unsubscribe, please send an email to: commits-unsubscr...@airflow.apache.org

Reply via email to