ashb opened a new pull request, #73918:
URL: https://github.com/apache/airflow/pull/73918

   Edge workers previously reported job state through a coordinate-addressed 
(i.e. 4- or 5-tuple) API backed by a coordinate primary key. The compatibility 
shim-based UUID executor bookkeeping alone cannot stop a late report from 
completing a replacement job for the "same" task.
   
   To fix it properly, we extend the job key with an attempt UUID (`ti.id`) and 
pass that identity from fetch to worker state reports. We preserve an empty 
discriminator for pre-upgrade jobs so old workers can finish those rows without 
touching newer attempts. Adoption reads the immutable UUID from the stored 
workload for legacy rows; resuming that same attempt reuses its row instead of 
creating a duplicate. Older supported airflow-core versions continue to 
schedule coordinate-keyed jobs.
   
   The migration requires upgraded API servers before schedulers create UUID 
jobs. New jobs require workers advertising UUID support; older workers can 
finish legacy jobs. Refuse schema downgrade while duplicate coordinate keys 
would collapse distinct jobs, and retain buffered logs while a sibling job 
still uses their coordinate namespace.
   
   ---
   
   <sub>Stack created with <a href="https://github.com/github/gh-stack";>GitHub 
Stacks CLI</a> • <a href="https://gh.io/stacks-feedback";>Give Feedback 
💬</a></sub>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to