GitHub user cookesan added a comment to the discussion: Task-level filtering 
for backfill in Airflow 3

This looks like a real Airflow 3 feature gap, not a hidden flag.

The Airflow 3 backfill path is centered on creating DagRuns for a DAG and date 
range. I do not see an equivalent of the old task regex flag on `airflow 
backfill create`. If the task instances already exist, `airflow tasks clear` 
can target selected tasks over a date range, but that is not the same as 
creating a new task-filtered backfill.

For now the practical options are to run a full backfill with the unwanted work 
guarded/short-circuited, use a temporary DAG version for the 
migration/backfill, or clear selected existing task instances when the DagRuns 
already exist. A PR for task-scoped backfill would need to define the scheduler 
semantics carefully, because creating only part of a DAG run interacts with 
dependencies, mapped tasks, assets, and downstream state.

GitHub link: 
https://github.com/apache/airflow/discussions/65298#discussioncomment-16657269

----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]

Reply via email to