Re: [I] Child process dies while api-server is hosted with docker [airflow]
DDavid5 commented on issue #52270: URL: https://github.com/apache/airflow/issues/52270#issuecomment-3642500826 > Another option is adding this to your values.yaml > > config: > api: > workers: 1 > For the Airflow development team: The issue is reproducible if you deploy the helm chart on a low-end Debian server using the kind k8s distribution I do not know why, but it is working with this solution. Does it mean that you disable KEDA ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] Child process dies while api-server is hosted with docker [airflow]
jedcunningham closed issue #52270: Child process dies while api-server is hosted with docker URL: https://github.com/apache/airflow/issues/52270 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] Child process dies while api-server is hosted with docker [airflow]
sortega commented on issue #52270: URL: https://github.com/apache/airflow/issues/52270#issuecomment-3258182510 BTW, this is happening to us in Airflow 3.0.6 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] Child process dies while api-server is hosted with docker [airflow]
sortega commented on issue #52270: URL: https://github.com/apache/airflow/issues/52270#issuecomment-3258181529 I think the root cause is [this upstream bug](https://github.com/Kludex/uvicorn/issues/2506) in uvicorn because downgrading it to 0.29.0 makes processes to stop dying. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] Child process dies while api-server is hosted with docker [airflow]
jesperbagge commented on issue #52270: URL: https://github.com/apache/airflow/issues/52270#issuecomment-3227988452 I have the same issues on 3.0.5 deployed on K8s. I've increased the allowed resources for the pod to a very generous amount but it still fails. Going through the event log tells me that the pod gets killed since the startup probe can't connect. ``` Startup probe failed: Get "http://:8080/api/v2/version": dial tcp :8080: connect: connection refused ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] Child process dies while api-server is hosted with docker [airflow]
jbanha commented on issue #52270: URL: https://github.com/apache/airflow/issues/52270#issuecomment-3160342467 I have a similar case. I get an increase in memory usage when specific calls are triggered from the UI. > [@brunolnetto](https://github.com/brunolnetto) please try the similar solution for docker compose way of deployment Here is a corresponding fragment of the docker-compose.yaml: > > ``` > services: > airflow-apiserver: > environment: > AIRFLOW__API__WORKERS: '1' > ``` This causes the full container to stop instead of the child process, it is consistent with what is described here: https://github.com/encode/uvicorn/issues/2506#issuecomment-2565287112 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] Child process dies while api-server is hosted with docker [airflow]
en-ver commented on issue #52270: URL: https://github.com/apache/airflow/issues/52270#issuecomment-3045921697 @brunolnetto please try the similar solution for docker compose way of deployment Here is a corresponding fragment of the docker-compose.yaml: ``` services: airflow-apiserver: environment: AIRFLOW__API__WORKERS: '1' ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] Child process dies while api-server is hosted with docker [airflow]
brunolnetto commented on issue #52270: URL: https://github.com/apache/airflow/issues/52270#issuecomment-3045883594 For the record, I am not using kubernetes rather plain docker-compose file. Additionally, migrating from 3.0.2 to 3.0.1 worked once, but failed again. This means, there is something subtle I am not aware of. I expected only to follow instructions available on [1] to host the required services. [1] https://airflow.apache.org/docs/apache-airflow/stable/howto/docker-compose/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
[I] Child process dies while api-server is hosted with docker [airflow]
brunolnetto opened a new issue, #52270:
URL: https://github.com/apache/airflow/issues/52270
### Apache Airflow version
3.0.2
### If "Other Airflow 2 version" selected, which one?
_No response_
### What happened?
While I am hosting airflow using documentation available
[here](https://airflow.apache.org/docs/apache-airflow/stable/howto/docker-compose/index.html),
the api server tok a looong time, with child dieing (sob) until it survived
and resumed the initialization. No idea what it can be.
```
_
|__( )_ __/__ / __
/| |_ /__ ___/_ /_ __ /_ __ \_ | /| / /
___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ /
_/_/ |_/_/ /_//_//_/ \//|__/
[2025-06-25T21:51:18.012+] {api_server_command.py:92} INFO - Running the
uvicorn with:
Apps: all
Workers: 4
Host: 0.0.0.0:8080
Timeout: 120
Logfiles: -
=
INFO: Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)
INFO: Started parent process [7]
INFO: Waiting for child process [72]
INFO: Child process [72] died
INFO: Waiting for child process [73]
INFO: Child process [73] died
INFO: Waiting for child process [74]
INFO: Child process [74] died
INFO: Waiting for child process [75]
...
INFO: Waiting for child process [1428]
INFO: Child process [1428] died
/home/airflow/.local/lib/python3.12/site-packages/flask_limiter/extension.py:324
UserWarning: Using the in-memory storage for tracking rate limits as no
storage was explicitly specified. This is not recommended for production use.
See: https://flask-limiter.readthedocs.io#configuring-a-storage-backend for
documentation about configuring the storage backend.
INFO: Started server process [1429]
INFO: Waiting for application startup.
INFO: Application startup complete.
INFO: 127.0.0.1:57618 - "GET /api/v2/version HTTP/1.1" 200 OK
```
### What you think should happen instead?
It should be fast to be healthy.
### How to reproduce
Follow these instructions:
https://airflow.apache.org/docs/apache-airflow/stable/howto/docker-compose/index.html
### Operating System
Ubuntu 24.04.1 LTS
### Versions of Apache Airflow Providers
_No response_
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
_No response_
### Anything else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Re: [I] Child process dies while api-server is hosted with docker [airflow]
en-ver commented on issue #52270: URL: https://github.com/apache/airflow/issues/52270#issuecomment-3037102480 Another option is adding this to your values.yaml ```yaml config: api: workers: 1 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] Child process dies while api-server is hosted with docker [airflow]
tirkarthi commented on issue #52270: URL: https://github.com/apache/airflow/issues/52270#issuecomment-3007089584 @brunolnetto What's the amount of memory used for the containers? Are you seeing any OOM or increased memory in the containers? We had similar issue with frequent restarts when 500MB and 1GB as requests and limits respectively. We have increased it to 1GB and 4GB as requests and limits respectively that resolved the issue. Related https://github.com/encode/uvicorn/issues/2506 , https://github.com/encode/uvicorn/issues/2466 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
[I] Child process dies while api-server is hosted with docker [airflow]
brunolnetto opened a new issue, #52270:
URL: https://github.com/apache/airflow/issues/52270
### Apache Airflow version
3.0.2
### If "Other Airflow 2 version" selected, which one?
_No response_
### What happened?
While I am hosting airflow using documentation available
[here](https://airflow.apache.org/docs/apache-airflow/stable/howto/docker-compose/index.html),
the api server tok a looong time, with child dieing (sob) until it survived
and resumed the initialization. No idea what it can be.
```
_
|__( )_ __/__ / __
/| |_ /__ ___/_ /_ __ /_ __ \_ | /| / /
___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ /
_/_/ |_/_/ /_//_//_/ \//|__/
[2025-06-25T21:51:18.012+] {api_server_command.py:92} INFO - Running the
uvicorn with:
Apps: all
Workers: 4
Host: 0.0.0.0:8080
Timeout: 120
Logfiles: -
=
INFO: Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)
INFO: Started parent process [7]
INFO: Waiting for child process [72]
INFO: Child process [72] died
INFO: Waiting for child process [73]
INFO: Child process [73] died
INFO: Waiting for child process [74]
INFO: Child process [74] died
INFO: Waiting for child process [75]
...
INFO: Waiting for child process [1428]
INFO: Child process [1428] died
/home/airflow/.local/lib/python3.12/site-packages/flask_limiter/extension.py:324
UserWarning: Using the in-memory storage for tracking rate limits as no
storage was explicitly specified. This is not recommended for production use.
See: https://flask-limiter.readthedocs.io#configuring-a-storage-backend for
documentation about configuring the storage backend.
INFO: Started server process [1429]
INFO: Waiting for application startup.
INFO: Application startup complete.
INFO: 127.0.0.1:57618 - "GET /api/v2/version HTTP/1.1" 200 OK
```
### What you think should happen instead?
It should be fast to be healthy.
### How to reproduce
Follow these instructions:
https://airflow.apache.org/docs/apache-airflow/stable/howto/docker-compose/index.html
### Operating System
Ubuntu 24.04.1 LTS
### Versions of Apache Airflow Providers
_No response_
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
_No response_
### Anything else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
