gr8web commented on issue #36920:
URL: https://github.com/apache/airflow/issues/36920#issuecomment-1981908959
> > The only thing what happened to the jobs is that the tasks were cleared
for few days in the past.
>
> Can you elaborate more on this? Like explain how it was cleared and your
DAG args
We have an `on_retry_callback` which would clear the tasks.
It looked like that:
```
airflow tasks clear -s {cleanup_date} -t {task_regex} -d -y {dag_id}
```
```
with DAG(
dag_id=DAG_ID,
schedule_interval=timedelta(minutes=10),
start_date=pendulum.datetime(2024, 3, 6, 10, 0, 0, tz="UTC"),
catchup=True,
default_args=get_config_value(KEY_DEFAULT_ARGS),
max_active_runs=1,
)
DEFAULT_ARGS = {
"depends_on_past": True,
"retries": 10,
}
```
`cleanup_date` is `execution_date`.
Some time later the start date for the jobs was changed to the present day.
We currently have 60 Jobs, with 2-3 tasks each.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
