asasisekar commented on issue #49887:
URL: https://github.com/apache/airflow/issues/49887#issuecomment-2835726633
@tirkarthi With running with 100 DAGs, DAG processor getting failed with too
many open files in few mins.
Around 390 open files
```
lrwx------ 1 svc svc 64 Apr 28 16:26 390 -> socket:[2348769229]
lrwx------ 1 svc svc 64 Apr 28 16:26 392 -> socket:[2348769231]
```
DAGs have lot of variables. is that creating too many open files ?
DAG processor have lot of below http calls in log.
```
[2025-04-28T16:25:37.142+0100] {_client.py:1026} INFO - HTTP Request: GET
http://in-process.invalid./variables/xxxx "HTTP/1.1 200 OK"
[2025-04-28T16:25:37.152+0100] {_client.py:1026} INFO - HTTP Request: GET
http://in-process.invalid./variables/yyyy "HTTP/1.1 200 OK"
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
