ashb opened a new pull request, #73918: URL: https://github.com/apache/airflow/pull/73918
Edge workers previously reported job state through a coordinate-addressed (i.e. 4- or 5-tuple) API backed by a coordinate primary key. The compatibility shim-based UUID executor bookkeeping alone cannot stop a late report from completing a replacement job for the "same" task. To fix it properly, we extend the job key with an attempt UUID (`ti.id`) and pass that identity from fetch to worker state reports. We preserve an empty discriminator for pre-upgrade jobs so old workers can finish those rows without touching newer attempts. Adoption reads the immutable UUID from the stored workload for legacy rows; resuming that same attempt reuses its row instead of creating a duplicate. Older supported airflow-core versions continue to schedule coordinate-keyed jobs. The migration requires upgraded API servers before schedulers create UUID jobs. New jobs require workers advertising UUID support; older workers can finish legacy jobs. Refuse schema downgrade while duplicate coordinate keys would collapse distinct jobs, and retain buffered logs while a sibling job still uses their coordinate namespace. --- <sub>Stack created with <a href="https://github.com/github/gh-stack">GitHub Stacks CLI</a> • <a href="https://gh.io/stacks-feedback">Give Feedback 💬</a></sub> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
