mporracindie opened a new issue #15951:
URL: https://github.com/apache/airflow/issues/15951


   **Description**
   The idea is to be able to mark specific tasks as critical making them define 
the output of the entire dag.
   
   **Use case / motivation**
   I'll use a specific example but this can be extended to many use cases. 
Let's say you use an operator to create an EMR cluster one for summiting code 
to the cluster and finally a cleanup one for killing the cluster when all the 
previous have finished.
   The task submitting code to EMR is critical and I would want the whole DAG 
run to be marked as failed if any of them fails. However, this doesn't happen 
cause the cleanup always runs successfully. (which is expected since we want 
the cluster finished regardless of the output of the previous tasks)
   
   With this example, I think I'm being clear. The end idea is to have more 
control over the dag run state when you have things like this:
   <img width="43" alt="Captura de Pantalla 2021-05-19 a la(s) 14 50 48" 
src="https://user-images.githubusercontent.com/42622776/118860389-b5938c00-b8b1-11eb-8152-9b5b93adbfdf.png";>
   
   **Are you willing to submit a PR?**
   Yes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to