The GitHub Actions job "Tests (AMD)" on airflow.git/redshift-cancel-statement-on-user-kill-deferred has succeeded. Run started by GitHub user steveahnahn (triggered by steveahnahn).
Head commit for run: a742e90bda8c763ebd0b984f78b299c914811c7a / Steve Ahn <[email protected]> Cancel the Redshift statement when a user kills the deferred task A deferred RedshiftDataOperator parks its query in the triggerer, so the operator's own on_kill no longer runs once the task is deferred. When a user marks that task failed, clears it, or marks it success, the trigger had no on_kill hook, so the Redshift statement kept running against the cluster or workgroup even though the operator already cancels the statement on kill in the non-deferred path. On Redshift Serverless a runaway statement keeps billing RPU-hours, and on a provisioned cluster it holds a WLM slot, until it finishes on its own. This adds on_kill to RedshiftDataTrigger to cancel the running statement when the user acts on the deferred task, matching the behaviour already shipped for the EMR, Dataproc, BigQuery, and Dataflow triggers. A cancel_on_kill flag on both the operator and the trigger lets users opt out. Report URL: https://github.com/apache/airflow/actions/runs/28986666635 With regards, GitHub Actions via GitBox --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
