Achal Soni created AIRFLOW-2279:
-----------------------------------
Summary: Clearing Tasks Across DAGs
Key: AIRFLOW-2279
URL: https://issues.apache.org/jira/browse/AIRFLOW-2279
Project: Apache Airflow
Issue Type: Improvement
Reporter: Achal Soni
Attachments: cross_dag_ui_screenshot.png
At Stripe, we commonly have discrete dags that depend on each other by
leveraging ExternalTaskSensors. We also find ourselves routinely wanting to not
only clear tasks and their downstream tasks in a particular dag, but also their
downstream tasks in their dependent dags (linked by ExternalTaskSensors).
We currently have extended Airflow to handle this by modifying the webapp and
cli tool to optionally clear dependent tasks across multiple dags (see attached
screenshot).
We want to open the floor for discussion with the larger Airflow community
about the usage of ExternalTaskSensors and specifically how to handle clearing
across dags. We are interested in learning more about the accepted practices in
this regard, and are very open/willing to contribute in this area if there is
interest!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
