[ 
https://issues.apache.org/jira/browse/AIRFLOW-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022350#comment-17022350
 ] 

ASF subversion and git services commented on AIRFLOW-2279:
----------------------------------------------------------

Commit 14111b4bddbaa7c7085a25cdfe923f88219e1582 in airflow's branch 
refs/heads/v1-10-test from Qian Yu
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=14111b4 ]

[AIRFLOW-2279] Clear tasks across DAGs if marked by ExternalTaskMarker (#6633)


> Clearing Tasks Across DAGs
> --------------------------
>
>                 Key: AIRFLOW-2279
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2279
>             Project: Apache Airflow
>          Issue Type: Improvement
>            Reporter: Achal Soni
>            Assignee: Qian Yu
>            Priority: Major
>             Fix For: 1.10.8
>
>         Attachments: cross_dag_ui_screenshot.png
>
>
> At Stripe, we commonly have discrete dags that depend on each other by 
> leveraging ExternalTaskSensors. We also find ourselves routinely wanting to 
> not only clear tasks and their downstream tasks in a particular dag, but also 
> their downstream tasks in their dependent dags (linked by 
> ExternalTaskSensors). 
> We currently have extended Airflow to handle this by modifying the webapp and 
> cli tool to optionally clear dependent tasks across multiple dags (see 
> attached screenshot). 
> We want to open the floor for discussion with the larger Airflow community 
> about the usage of ExternalTaskSensors and specifically how to handle 
> clearing across dags. We are interested in learning more about the accepted 
> practices in this regard, and are very open/willing to contribute in this 
> area if there is interest!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to