crabio commented on issue #35354:
URL: https://github.com/apache/airflow/issues/35354#issuecomment-1790365264
Also we figured out that some time tasks failed without any reason and
without retries.
```log
[[34m2023-11-02T03:13:05.686+0000[0m] {[34mtaskinstance.py:[0m1441}
WARNING[0m - cannot record scheduled_duration for task AAA because previous
state change time has not been saved[0m
[[34m2023-11-02T03:13:05.686+0000[0m] {[34mbase_executor.py:[0m144}
INFO[0m - Adding to queue: ['airflow', 'tasks', 'run', 'AAA', 'AAA',
'scheduled__2023-11-02T02:00:00+00:00', '--local', '--subdir',
'DAGS_FOLDER/dags/AAA.py'][0m
[[34m2023-11-02T03:13:05.686+0000[0m]
{[34mscheduler_job_runner.py:[0m636} INFO[0m - Sending
TaskInstanceKey(dag_id='AAA', task_id='AAA',
run_id='scheduled__2023-11-02T02:00:00+00:00', try_number=1, map_index=-1) to
executor with priority 1 and queue default[0m
[[34m2023-11-02T03:13:05.691+0000[0m]
{[34mkubernetes_executor.py:[0m312} INFO[0m - Add task
TaskInstanceKey(dag_id='AAA', task_id='AAA',
run_id='scheduled__2023-11-02T02:00:00+00:00', try_number=1, map_index=-1) with
command ['airflow', 'tasks', 'run', 'AAA', 'AAA',
'scheduled__2023-11-02T02:00:00+00:00', '--local', '--subdir',
'DAGS_FOLDER/dags/AAA.py'][0m
[[34m2023-11-02T03:13:05.839+0000[0m]
{[34mkubernetes_executor_utils.py:[0m396} INFO[0m - Creating kubernetes pod
for job is TaskInstanceKey(dag_id='AAA', task_id='AAA',
run_id='scheduled__2023-11-02T02:00:00+00:00', try_number=1, map_index=-1),
with pod name AAA-783qadx4, annotations: <omitted>[0m
[[34m2023-11-02T03:13:06.120+0000[0m]
{[34mscheduler_job_runner.py:[0m686} INFO[0m - Received executor event with
state queued for task instance TaskInstanceKey(dag_id='AAA', task_id='AAA',
run_id='scheduled__2023-11-02T02:00:00+00:00', try_number=1, map_index=-1)[0m
[[34m2023-11-02T03:14:23.708+0000[0m]
{[34mkubernetes_executor.py:[0m356} INFO[0m - Changing state of
(TaskInstanceKey(dag_id='AAA', task_id='AAA',
run_id='scheduled__2023-11-02T02:00:00+00:00', try_number=1, map_index=-1),
<TaskInstanceState.FAILED: 'failed'>, 'AAA-783qadx4', '520667263') to failed[0m
[[34m2023-11-02T03:14:23.715+0000[0m]
{[34mkubernetes_executor.py:[0m441} INFO[0m - Deleted pod:
TaskInstanceKey(dag_id='AAA', task_id='AAA',
run_id='scheduled__2023-11-02T02:00:00+00:00', try_number=1, map_index=-1) in
namespace BBB[0m
[[34m2023-11-02T03:14:23.725+0000[0m]
{[34mscheduler_job_runner.py:[0m686} INFO[0m - Received executor event with
state failed for task instance TaskInstanceKey(dag_id='AAA', task_id='AAA',
run_id='scheduled__2023-11-02T02:00:00+00:00', try_number=1, map_index=-1)[0m
[[34m2023-11-02T03:14:23.787+0000[0m]
{[34mscheduler_job_runner.py:[0m723} INFO[0m - TaskInstance Finished:
dag_id=AAA, task_id=AAA, run_id=scheduled__2023-11-02T02:00:00+00:00,
map_index=-1, run_start_date=None, run_end_date=None, run_duration=None,
state=queued, executor_state=failed, try_number=1, max_tries=0, job_id=None,
pool=pool, queue=default, priority_weight=1, operator=CustomOperator,
queued_dttm=2023-11-02 03:13:05.681227+00:00, queued_by_job_id=166781,
pid=None[0m
```
But in next run this task succeed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
