ephraimbuddy commented on issue #36920:
URL: https://github.com/apache/airflow/issues/36920#issuecomment-1982837483
> > > The only thing what happened to the jobs is that the tasks were
cleared for few days in the past.
> >
> >
> > Can you elaborate more on this? Like explain how it was cleared and your
DAG args
>
> We have an `on_retry_callback` which would clear the tasks. It looked like
that:
>
> ```
> airflow tasks clear -s {cleanup_date} -t {task_regex} -d -y {dag_id}
> ```
>
> ```
> with DAG(
> dag_id=DAG_ID,
> schedule_interval=timedelta(minutes=10),
> start_date=pendulum.datetime(2024, 3, 6, 10, 0, 0, tz="UTC"),
> catchup=True,
> default_args=get_config_value(KEY_DEFAULT_ARGS),
> max_active_runs=1,
> )
>
> DEFAULT_ARGS = {
> "depends_on_past": True,
> "retries": 10,
> }
> ```
>
> `cleanup_date` is `execution_date`. Some time later the start date for the
jobs was changed to the present day.
>
> We currently have 60 Jobs, with 2-3 tasks each.
Can you try having the start date be static date in the past?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
