SameerMesiah97 opened a new pull request, #67360:
URL: https://github.com/apache/airflow/pull/67360

   **Description**
   
   This change fixes a regression introduced in PR #66449 affecting 
`DbtCloudRunJobOperator` in deferrable mode.
   
   Previously, `execution_timeout` was passed directly to `defer()`. The 
operator now explicitly passes `timeout=None` to `defer()` while still 
preserving `execution_deadline` handling within the trigger/operator flow.
   
   **Rationale**
   
   In deferrable mode, dbt job cancellation is performed within 
`execute_complete()` when the trigger emits a timeout event.
   
   However, framework-level deferred timeout handling bypasses 
`execute_complete()` entirely and does not invoke `on_kill()` in the triggerer 
process. As a result, dbt jobs could continue running after the Airflow task 
timed out, leading to leaked workloads and excessive resource consumption.
   
   While this weakens the framework-level deferred timeout guarantee, in this 
case preventing leaked external workloads takes precedence because there is 
currently no equivalent cleanup path in the triggerer process.
   
   **Tests**
   
   Added an operator-level regression test verifying that `defer()` is called 
with `timeout=None` while `execution_deadline` handling remains preserved for 
dbt job timeout cancellation processing.
   
   **Backwards Compatibility**
   
   This change does not modify public APIs or method signatures.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to