dheerajturaga opened a new pull request, #65826:
URL: https://github.com/apache/airflow/pull/65826
Workers launched with --celery-hostname reserved tasks from the broker
but never dispatched them to pool workers, leaving tasks stuck with
acknowledged=False and worker_pid=None.
The duplicate-hostname check ran celery_app.control.inspect() on the
same app later handed to worker_main(). Inspect opens broker connections
and initializes kombu's process-global producer/connection pools; the
prefork worker's master-to-child dispatch path gets wedged by that
pre-warmed state after fork.
Run the inspect against a throwaway Celery app configured from the real
app's conf, then call kombu.pools.reset() so no pool state leaks into
the app that boots the worker.
closes: #59707
---
##### Was generative AI tooling used to co-author this PR?
<!--
If generative AI tooling has been used in the process of authoring this PR,
please
change below checkbox to `[X]` followed by the name of the tool, uncomment
the "Generated-by".
-->
- [ ] Yes (please specify the tool below)
ClaudeCode
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
