databius commented on issue #40957: URL: https://github.com/apache/airflow/issues/40957#issuecomment-2309864273
In my case, I am using CeleryKubernetesExecutor and tasks running on
KubernetesExecutor are also facing the same issue.
airflow-scheduler log in my case:
```
[2024-08-26T09:35:30.915+0000] {retries.py:91} DEBUG - Running
SchedulerJobRunner._create_dagruns_for_dags with retries. Try 1 of 3
[2024-08-26T09:35:30.925+0000] {retries.py:91} DEBUG - Running
SchedulerJobRunner._get_next_dagruns_to_examine with retries. Try 1 of 3
[2024-08-26T09:35:30.931+0000] {retries.py:91} DEBUG - Running
SchedulerJobRunner._get_next_dagruns_to_examine with retries. Try 1 of 3
[2024-08-26T09:35:30.936+0000] {retries.py:91} DEBUG - Running
SchedulerJobRunner._schedule_all_dag_runs with retries. Try 1 of 3
[2024-08-26T09:35:30.948+0000] {scheduler_job_runner.py:412} DEBUG - No
tasks to consider for execution.
[2024-08-26T09:35:30.950+0000] {base_executor.py:222} DEBUG - 0 running task
instances
[2024-08-26T09:35:30.950+0000] {base_executor.py:223} DEBUG - 0 in queue
[2024-08-26T09:35:30.951+0000] {base_executor.py:224} DEBUG - 8 open slots
[2024-08-26T09:35:30.952+0000] {base_executor.py:243} DEBUG - Calling the
<class 'airflow.providers.celery.executors.celery_executor.CeleryExecutor'>
sync method
[2024-08-26T09:35:30.952+0000] {celery_executor.py:325} DEBUG - No task to
query celery, skipping sync
[2024-08-26T09:35:30.952+0000] {base_executor.py:222} DEBUG - 1 running task
instances
[2024-08-26T09:35:30.952+0000] {base_executor.py:223} DEBUG - 0 in queue
[2024-08-26T09:35:30.952+0000] {base_executor.py:224} DEBUG - 7 open slots
[2024-08-26T09:35:30.953+0000] {base_executor.py:243} DEBUG - Calling the
<class
'airflow.providers.cncf.kubernetes.executors.kubernetes_executor.KubernetesExecutor'>
sync method
[2024-08-26T09:35:30.953+0000] {kubernetes_executor.py:367} DEBUG -
self.running: {TaskInstanceKey(dag_id='my_dag', task_id='my-operator',
run_id='manual__2024-08-26T16:20:48+07:00', try_number=1, map_index=-1)}
[2024-08-26T09:35:30.954+0000] {kubernetes_executor_utils.py:475} DEBUG -
Syncing KubernetesExecutor
[2024-08-26T09:35:30.954+0000] {kubernetes_executor_utils.py:383} DEBUG -
KubeJobWatcher for namespace nprod-green-lab-airflow alive, continuing
[2024-08-26T09:35:30.955+0000] {kubernetes_executor.py:454} DEBUG - Next
timed event is in 4.329895
[2024-08-26T09:35:30.956+0000] {retries.py:91} DEBUG - Running
Job._fetch_from_db with retries. Try 1 of 3
[2024-08-26T09:35:30.959+0000] {retries.py:91} DEBUG - Running
Job._update_heartbeat with retries. Try 1 of 3
[2024-08-26T09:35:30.962+0000] {job.py:214} DEBUG - [heartbeat]
[2024-08-26T09:35:30.963+0000] {event_scheduler.py:39} DEBUG - Calling
<bound method SchedulerJobRunner._emit_pool_metrics of
<airflow.jobs.scheduler_job_runner.SchedulerJobRunner object at
0x7f4dd128a400>>
[2024-08-26T09:35:30.969+0000] {scheduler_job_runner.py:990} DEBUG - Next
timed event is in 4.482330
[2024-08-26T09:35:30.969+0000] {scheduler_job_runner.py:992} DEBUG - Ran
scheduling loop in 0.05 seconds
[2024-08-26T09:35:31.971+0000] {retries.py:91} DEBUG - Running
SchedulerJobRunner._create_dagruns_for_dags with retries. Try 1 of 3
[2024-08-26T09:35:31.983+0000] {retries.py:91} DEBUG - Running
SchedulerJobRunner._get_next_dagruns_to_examine with retries. Try 1 of 3
[2024-08-26T09:35:31.994+0000] {retries.py:91} DEBUG - Running
SchedulerJobRunner._get_next_dagruns_to_examine with retries. Try 1 of 3
[2024-08-26T09:35:31.999+0000] {retries.py:91} DEBUG - Running
SchedulerJobRunner._schedule_all_dag_runs with retries. Try 1 of 3
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
