[ https://issues.apache.org/jira/browse/AIRFLOW-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022350#comment-17022350 ]
ASF subversion and git services commented on AIRFLOW-2279: ---------------------------------------------------------- Commit 14111b4bddbaa7c7085a25cdfe923f88219e1582 in airflow's branch refs/heads/v1-10-test from Qian Yu [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=14111b4 ] [AIRFLOW-2279] Clear tasks across DAGs if marked by ExternalTaskMarker (#6633) > Clearing Tasks Across DAGs > -------------------------- > > Key: AIRFLOW-2279 > URL: https://issues.apache.org/jira/browse/AIRFLOW-2279 > Project: Apache Airflow > Issue Type: Improvement > Reporter: Achal Soni > Assignee: Qian Yu > Priority: Major > Fix For: 1.10.8 > > Attachments: cross_dag_ui_screenshot.png > > > At Stripe, we commonly have discrete dags that depend on each other by > leveraging ExternalTaskSensors. We also find ourselves routinely wanting to > not only clear tasks and their downstream tasks in a particular dag, but also > their downstream tasks in their dependent dags (linked by > ExternalTaskSensors). > We currently have extended Airflow to handle this by modifying the webapp and > cli tool to optionally clear dependent tasks across multiple dags (see > attached screenshot). > We want to open the floor for discussion with the larger Airflow community > about the usage of ExternalTaskSensors and specifically how to handle > clearing across dags. We are interested in learning more about the accepted > practices in this regard, and are very open/willing to contribute in this > area if there is interest! -- This message was sent by Atlassian Jira (v8.3.4#803005)