Taragolis commented on issue #34869: URL: https://github.com/apache/airflow/issues/34869#issuecomment-1759951396
I can't reproduce, this sample retries without any issues ```python from datetime import timedelta from airflow.decorators import task from airflow.models.dag import DAG from airflow.operators.python import ShortCircuitOperator from airflow.utils.timezone import datetime def _process(): return 1 / 0 with DAG( "issue_34869", start_date=datetime(2023, 10, 1), schedule_interval="@daily", catchup=False, tags=["issue", "34869"] ) as dag: task_a = ShortCircuitOperator( task_id = "always_failed", python_callable = _process, retries=999_999, retry_delay=timedelta(seconds=1) ) @task def task_b(): ... task_a >> task_b() ``` ```console 4792c3ee7560 *** Found local files: *** * /root/airflow/logs/dag_id=issue_34869/run_id=scheduled__2023-10-11T00:00:00+00:00/task_id=always_failed/attempt=120.log [2023-10-12, 16:17:45 UTC] {taskinstance.py:1914} INFO - Dependencies all met for dep_context=non-requeueable deps ti=<TaskInstance: issue_34869.always_failed scheduled__2023-10-11T00:00:00+00:00 [queued]> [2023-10-12, 16:17:45 UTC] {taskinstance.py:1914} INFO - Dependencies all met for dep_context=requeueable deps ti=<TaskInstance: issue_34869.always_failed scheduled__2023-10-11T00:00:00+00:00 [queued]> [2023-10-12, 16:17:45 UTC] {taskinstance.py:2116} INFO - Starting attempt 120 of 1000000 [2023-10-12, 16:17:45 UTC] {taskinstance.py:2137} INFO - Executing <Task(ShortCircuitOperator): always_failed> on 2023-10-11 00:00:00+00:00 [2023-10-12, 16:17:45 UTC] {standard_task_runner.py:60} INFO - Started process 1091 to run task [2023-10-12, 16:17:45 UTC] {standard_task_runner.py:87} INFO - Running: ['***', 'tasks', 'run', 'issue_34869', 'always_failed', 'scheduled__2023-10-11T00:00:00+00:00', '--job-id', '122', '--raw', '--subdir', 'DAGS_FOLDER/issue_34869.py', '--cfg-path', '/tmp/tmprrzxh1ux'] [2023-10-12, 16:17:45 UTC] {standard_task_runner.py:88} INFO - Job 122: Subtask always_failed [2023-10-12, 16:17:45 UTC] {task_command.py:421} INFO - Running <TaskInstance: issue_34869.always_failed scheduled__2023-10-11T00:00:00+00:00 [running]> on host 4792c3ee7560 [2023-10-12, 16:17:45 UTC] {taskinstance.py:2390} INFO - Exporting env vars: AIRFLOW_CTX_DAG_OWNER='***' AIRFLOW_CTX_DAG_ID='issue_34869' AIRFLOW_CTX_TASK_ID='always_failed' AIRFLOW_CTX_EXECUTION_DATE='2023-10-11T00:00:00+00:00' AIRFLOW_CTX_TRY_NUMBER='120' AIRFLOW_CTX_DAG_RUN_ID='scheduled__2023-10-11T00:00:00+00:00' [2023-10-12, 16:17:45 UTC] {taskinstance.py:2608} ERROR - Task failed with exception Traceback (most recent call last): File "/opt/airflow/airflow/models/taskinstance.py", line 432, in _execute_task result = execute_callable(context=context, **execute_callable_kwargs) File "/opt/airflow/airflow/operators/python.py", line 263, in execute condition = super().execute(context) File "/opt/airflow/airflow/operators/python.py", line 195, in execute return_value = self.execute_callable() File "/opt/airflow/airflow/operators/python.py", line 212, in execute_callable return self.python_callable(*self.op_args, **self.op_kwargs) File "/files/dags/issue_34869.py", line 8, in _process return 1 / 0 ZeroDivisionError: division by zero [2023-10-12, 16:17:45 UTC] {taskinstance.py:1130} INFO - Marking task as UP_FOR_RETRY. dag_id=issue_34869, task_id=always_failed, execution_date=20231011T000000, start_date=20231012T161745, end_date=20231012T161745 [2023-10-12, 16:17:45 UTC] {standard_task_runner.py:107} ERROR - Failed to execute job 122 for task always_failed (division by zero; 1091) [2023-10-12, 16:17:45 UTC] {local_task_job_runner.py:233} INFO - Task exited with return code 1 [2023-10-12, 16:17:45 UTC] {taskinstance.py:3188} INFO - 0 downstream tasks scheduled from follow-on schedule check ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org