The GitHub Actions job "Tests (AMD)" on airflow.git/airflow-65923 has succeeded.
Run started by GitHub user FrankYang0529 (triggered by FrankYang0529).

Head commit for run:
5edcf3a89e2a1aa9f239143b35883dcbdb1231c6 / PoAn Yang <[email protected]>
Add rerun policy for rollups when an upstream partition is re-run

When an upstream partition that a rollup's downstream window already
consumed is cleared and re-run, the framework had no defined behavior.
The de-facto outcome silently depended on the rollup's wait policy:
WaitForAll left a provisional run stuck waiting for keys that never
re-arrive, while MinimumCount re-fired the downstream run on partial
data. Neither is something a Dag author can rely on.

Give RollupMapper an explicit rerun_policy so the author chooses what
happens. The default preserves the historical behavior, so existing
Dags are unchanged; re-firing with the corrected data is opt-in.

Signed-off-by: PoAn Yang <[email protected]>

Report URL: https://github.com/apache/airflow/actions/runs/27861404796

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to