tanelk commented on issue #29416: URL: https://github.com/apache/airflow/issues/29416#issuecomment-1423685677
There is one more thing to keep in mind. The lifecycle of a deferrable task is something like this: none -> scheduled -> queued -> running -> deferred -> scheduled -> queued -> running -> success Currently it only consumes pool slots in queued and running states and you'd like to add deferred to that list. In that chain there still is a scheduled (the second one), that splits the execution into two parts. Handling that could be little more work than just updating the `Pool.slots_stats`. `TI.next_method` could be used to distinguish the two scheduled states but that does not jibe with scheduler. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
