sebastian-popa opened a new issue, #12928:
URL: https://github.com/apache/apisix/issues/12928

   ### Description
   
   Running APISIX in Kubernetes, have been noticing memory going up constantly, 
and when it gets to 70-75%, Kubernetes kills the pods. In next image, first 
sawtooth at 70% is Kube killing the pods, the other ones are me restarting the 
pods.
   
   <img width="316" height="240" alt="Image" 
src="https://github.com/user-attachments/assets/805139dd-080c-4fc1-a79d-fb2861c0a8dd";
 />
   
     
   
   Tried to reproduce locally, ran the same version with same configurations in 
my Docker, locally, and created a (K6) script to exercise one of the routes 
which I think might be related to the issue. Same request (route, payload), 
over and over, for 10 min, simulating 20 users. Exec-ed in the docker 
container, ran top command, noticed a raise in memory after each run.  
     
   **First run of 10min**  
   
   <img width="988" height="656" alt="Image" 
src="https://github.com/user-attachments/assets/8fc897c5-88a0-48bd-bf5f-fe543a458aa8";
 />
     
   ...
   **Second run of 10min**  
   
   <img width="988" height="656" alt="Image" 
src="https://github.com/user-attachments/assets/d0f8a05f-57b2-4bbf-b4a6-c19a05e0092e";
 />
   
   ...  
   **Fourth run of 10min**  
   
   <img width="988" height="656" alt="Image" 
src="https://github.com/user-attachments/assets/ef1169c8-35e4-410a-8c2e-9bc3cd1d953b";
 />
   
   ...
   Looks like luajit went from 0.8% to 4%, which COULD explain the memory going 
up constantly. Digging around, found 2 links which might pertain to this issue: 
   1. https://github.com/apache/apisix/issues/11680 - this suggests setting a 
"memory limit" ("It does not appear to be a leak but rather the allocator 
behavior. Once a memory limit was set, this behavior was not observed again in 
3.13"), any idea which memory limit for allocator it's talking about? 
   2. https://blog.openresty.com/en/luajit-plus/ - this one seems to be a plug 
for some "LuaJIT-plus", unclear if useful
   
   Any help on dealing with this? 
   Thanks! 
   
   ### Environment
   
   - APISIX version (run `apisix version`): 3.13
   - Operating system (run `uname -a`): Linux 0abad5fe5166 6.10.14-linuxkit #1 
SMP Tue Apr 15 16:00:54 UTC 2025 aarch64 GNU/Linux
   - OpenResty / Nginx version (run `openresty -V` or `nginx -V`): nginx 
version: openresty/1.27.1.2
   - etcd version, if relevant (run `curl 
http://127.0.0.1:9090/v1/server_info`): N/A
   - APISIX Dashboard version, if relevant: N/A
   - Plugin runner version, for issues related to plugin runners: N/A
   - LuaRocks version, for installation issues (run `luarocks --version`): N/A
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to