GitHub user michaelosthege added a comment to the discussion: High CPU and database load caused by Airflow 3 dag-processor and scheduler
No significant difference with 3.0.3rc6. <img width="2775" height="530" alt="image" src="https://github.com/user-attachments/assets/34ef0619-e1ac-4da5-a52b-f0e938c2d6d2"; /> Unsurprising, because * [the only change to `dag_processing/manager.py`](https://github.com/apache/airflow/compare/3.0.2...3.0.3rc6#diff-ab04d49f916c0bd418143e70f1c1ac6b335e8a98526c4a705404b76f3c9cdb93) did not fix this [`while (true)` loop that burns CPU cycles at maximum speed](https://github.com/apache/airflow/blob/3.0.3rc6/airflow-core/src/airflow/dag_processing/manager.py#L333-L380) as far as I can tell. * [and changes to `jobs/scheduler_job_runner.py` also appear unrelated](https://github.com/apache/airflow/compare/3.0.2...3.0.3rc6#diff-072241d81275cd4b4b867f51025e9dca800610069305cffeb4b77ad45e135557) Should I make a PR to have that `while (true)` loop be a little more patient and only run in predefined intervals? GitHub link: https://github.com/apache/airflow/discussions/53177#discussioncomment-13746137 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
