shaealh opened a new pull request, #69807: URL: https://github.com/apache/airflow/pull/69807
closes: #63580 ## Problem After a Redis broker restart, a Celery worker can remain alive and continue responding to `ping` while no longer consuming tasks from any queue. The existing Docker Compose and Helm liveness probes therefore remain healthy while queued tasks accumulate. ## Solution - Add `airflow celery check-worker`, targeted to a specific worker hostname. - Fail the check when the worker does not reply, is absent from the response, or reports no active queues. - Use the new command in the default Docker Compose and Helm worker liveness checks. - Fall back to the existing Celery `inspect ping` command when an older Celery provider does not recognize `check-worker`. - Update the Celery worker health-check documentation. ## Testing - 27 focused Celery provider CLI tests passed, covering healthy workers, no response, an empty response, a different responding worker, and a worker with no queues. - Ruff formatting and lint checks passed. - YAML lint and Helm chart lint passed. - Relevant pre-commit hooks passed. - The local kubeconform hook could not run because the Breeze shim is not installed. - The focused local Helm rendering test could not run because the `helm` executable is not installed. --- ##### Was generative AI tooling used to co-author this PR? - [x] Yes — OpenAI Codex (GPT-5) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
