darshil929 commented on PR #68954: URL: https://github.com/apache/airflow/pull/68954#issuecomment-4822221430
Before/after on a running dag with a value-externalizing custom XCom backend. **Setup** (Breeze, SQLite). The built-in object-storage backend with the threshold set to `0`, so every value, including the branch decision is externalized to a reference instead of stored inline: AIRFLOW__CORE__XCOM_BACKEND=airflow.providers.common.io.xcom.backend.XComObjectStorageBackend AIRFLOW__COMMON_IO__XCOM_OBJECTSTORAGE_PATH=file:///files/xcoms AIRFLOW__COMMON_IO__XCOM_OBJECTSTORAGE_THRESHOLD=0 The branch skips `should_be_skipped` directly on the worker on the first run, so the regression only surfaces once the scheduler re-evaluates the skip via `NotPreviouslySkippedDep` i.e. after the task is cleared. So each run is triggered, then `should_be_skipped` is cleared. #### Cleared task — before vs after Without the fix the cleared task **runs** (Try 1); with the fix it **stays skipped** (Try 0). Before — no fix: <img width="2000" height="1299" alt="image" src="https://github.com/user-attachments/assets/c9651b4e-3932-4190-860b-f092d48c087d"; /> After — with fix: <img width="1280" height="831" alt="image" src="https://github.com/user-attachments/assets/e29fc1e4-3f75-4405-97b4-acd771851d8b"; /> #### Task log — before vs after Before — no fix (body executed): <img width="2000" height="1299" alt="image" src="https://github.com/user-attachments/assets/71576645-244b-49c8-af21-b486f15e71aa"; /> After — with fix (task was skipped): <img width="2000" height="1299" alt="image" src="https://github.com/user-attachments/assets/988c5917-a7e1-41ba-88b6-45f3a595a55f"; /> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
