GitHub user lanxixulei added a comment to the discussion: AIRFLOW 2.5.0 with
celeryExecutor has experienced frequent schedule crashes, with crashes
occurring every few days recently. I noticed that there are many time-wait
socket processes in the background, such as 750 time-wait out of 800, and only
50 are established. Has anyone encountered a similar situation?
In addition, the following information was found when restarting the scheduler.
Looks like the executor has gone down?
scheduler logļ¼
2025-02-07 08:00:04,230 INFO - Starting the scheduler
2025-02-07 08:00:04,231 INFO - Processing each file at most -1 times
2025-02-07 08:00:04,298 INFO - Loaded executor: CeleryExecutor
2025-02-07 08:00:04,304 INFO - Launched DagFileProcessorManager with pid: 121657
2025-02-07 08:00:04,308 INFO - Resetting orphaned tasks for active dag runs
2025-02-07 08:00:04,315 INFO - Configured default timezone
Timezone('Asia/Shanghai')
2025-02-07 08:00:04,447 INFO - Adopted the following 10 tasks from a dead
executor
and the file airflow-worker.err appear
GitHub link:
https://github.com/apache/airflow/discussions/46581#discussioncomment-12113950
----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]
