The GitHub Actions job "Tests (ARM)" on airflow.git/main has failed.
Run started by GitHub user potiuk (triggered by potiuk).

Head commit for run:
1fd77cdd4282a53be1103c15c1f8976f03831b45 / Sean Ghaeli 
<[email protected]>
Make RedshiftDeleteClusterOperator delete reliably during cluster transitions 
(#69574)

A delete issued while the cluster is mid-transition (pausing/resuming/resizing)
raises InvalidClusterStateFault. The retry budget was hardcoded to 10 * 15s =
2.5 min, which expires long before a real transition settles (~minutes), so the
task fails and the cluster leaks.

Non-deferrable mode: raise the synchronous busy-retry budget to 60 * 15s = ~15
min so it outlasts a transition; still fail-loud once exhausted.

Deferrable mode: previously the synchronous loop ran before the defer, blocking
the worker. Now attempt the delete once; on InvalidClusterStateFault defer to a
new RedshiftClusterSettledTrigger (an AwsBaseWaiterTrigger backed by a custom
cluster_deletable waiter that treats transitional states as retry and fires once
the cluster is deletable), then a callback re-issues the delete and defers to 
the
existing RedshiftDeleteClusterTrigger; re-defers on a race. Bounded by the
existing poll_interval/max_attempts. This mirrors the EKS deferrable re-defer
pattern and the AwsBaseWaiterTrigger convention used by the other Redshift
triggers. No worker is blocked in deferrable mode.

Report URL: https://github.com/apache/airflow/actions/runs/29952995428

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to