Try depends_on_past=True

Get Outlook for Android<https://aka.ms/ghei36>

________________________________
From: Vishnuraayan G <[email protected]>
Sent: Tuesday, December 24, 2019 7:36:05 AM
To: [email protected] <[email protected]>
Subject: Facing issue with Backfill for a DAG - Please Help

Hi,

I have an issue with running backfill for a DAG in Airflow for multiple dates.

Airflow version: v1.10.5

What I am looking for is when I run a backfill for multiple dates, then all the 
tasks in DAG for a specific date should execute first and then the next date 
and so on.

But I am noticing that the first task is running for all dates, then the next 
task for all dates and so on. So, first dag run is not finishing before the 
second dag run.

Here are the dag parameters that I am using.

  *   max_active_runs=1
Only 1 dag run at a time
  *   concurrency=1
There are multiple branches in the DAG. Want only 1 task to run at a time.
  *   depends_on_past=False
for all tasks

Please help as I need to run this for more than 2 months and it would be 
difficult to run for individual dates.

Thanks
Vishnuraayan

Reply via email to