GitHub user eladkal added a comment to the discussion: 
RedshiftCreateClusterOperator leaks Redshift cluster on failure with partial 
IAM permissions

> If the operator fails after successfully initiating cluster creation (for 
> example due to missing DescribeClusters or other follow-up permissions), it 
> should make a best-effort attempt to clean up the partially created resource 
> by deleting the cluster.

Use setup and teardown to spin and clean resources

https://airflow.apache.org/docs/apache-airflow/stable/howto/setup-and-teardown.html#setup-and-teardown

There is no need to implement such logic per operator.

GitHub link: 
https://github.com/apache/airflow/discussions/61930#discussioncomment-15807951

----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]

Reply via email to