Hello, We see the following messages in logs:
uWSGI listen queue of socket "0.0.0.0:5002" (fd: 10) full !!! (101/100) It's not related to restart. I can reproduce it by bombarding app using ab tool: ab -k -l -r -c 200 -n 10000 http://192.168.1.48:5002/ This request lookups in apps' routing table, fails and returns 404. App's configuration: [uwsgi] buffer-size = 16384 log-master-bufsize = 32768 http-socket = 0.0.0.0:5002 psgi = /srv/sports/perl-deps/bin/sprt-combiner.psgi processes = 1 master = true uid = sports gid = sports plugin = http, coroae, logfile coroae = 512 harakiri = 10 harakiri-verbose = true reload-mercy = 4 max-requests = 100000 req-logger = file:/var/log/uwsgi/app/combiner.access.log stats = 0.0.0.0:5052 I've increased number cores and decreased number of processes to 1 so I can strace worker, here is strace from worker: 08:54:44.965905 accept4(10, {sa_family=AF_INET, sin_port=htons(53595), sin_addr=inet_addr("192.168.150.158")}, [16], SOCK_NONBLOCK) = 15 <0.000021> 08:54:44.965986 read(23, "GET / HTTP/1.0\r\nConnection: Keep"..., 16384) = 105 <0.000021> 08:54:44.966752 write(2, "[TRACE][b414fb46]\n\t0 - 0.000495("..., 136) = 136 <0.000040> 08:54:44.966922 writev(23, [{"HTTP/1.0 404 Not Found\r\ncontent-"..., 67}, {"Not found", 9}], 2) = 76 <0.000035> 08:54:44.967017 close(23) = 0 <0.000031> 08:54:44.967102 writev(8, [{"[pid: 26800|app: 0|req: 113092/1"..., 208}], 1) = 208 <0.000027> 08:54:44.967237 epoll_ctl(11, EPOLL_CTL_ADD, 15, {EPOLLIN, {u32=15, u64=25378961752079}}) = 0 <0.000022> 08:54:44.967310 epoll_wait(11, [{EPOLLIN, {u32=10, u64=4294967306}}, {EPOLLIN, {u32=15, u64=25378961752079}}], 64, 4780) = 2 <0.000018> 08:54:44.967378 accept4(10, {sa_family=AF_INET, sin_port=htons(53587), sin_addr=inet_addr("192.168.150.158")}, [16], SOCK_NONBLOCK) = 23 <0.000021> 08:54:44.967464 read(15, "GET / HTTP/1.0\r\nConnection: Keep"..., 16384) = 105 <0.000021> 08:54:44.968212 write(2, "[TRACE][cb58862b]\n\t0 - 0.0005(0."..., 132) = 132 <0.000046> 08:54:44.968357 writev(15, [{"HTTP/1.0 404 Not Found\r\ncontent-"..., 67}, {"Not found", 9}], 2) = 76 <0.000035> 08:54:44.968450 close(15) = 0 <0.000031> 08:54:44.968524 writev(8, [{"[pid: 26800|app: 0|req: 113093/1"..., 208}], 1) = 208 <0.000027> 08:54:44.968654 epoll_ctl(11, EPOLL_CTL_ADD, 23, {EPOLLIN, {u32=23, u64=8194797600791}}) = 0 <0.000023> 08:54:44.968727 epoll_wait(11, [{EPOLLIN, {u32=10, u64=4294967306}}, {EPOLLIN, {u32=23, u64=8194797600791}}], 64, 4778) = 2 <0.000018> 08:54:44.968789 accept4(10, {sa_family=AF_INET, sin_port=htons(53599), sin_addr=inet_addr("192.168.150.158")}, [16], SOCK_NONBLOCK) = 15 <0.000021> 08:54:44.968869 read(23, "GET / HTTP/1.0\r\nConnection: Keep"..., 16384) = 105 <0.000020> 08:54:44.969653 write(2, "[TRACE][b5f9dff7]\n\t0 - 0.000506("..., 136) = 136 <0.000047> 08:54:44.969812 writev(23, [{"HTTP/1.0 404 Not Found\r\ncontent-"..., 67}, {"Not found", 9}], 2) = 76 <0.000036> 08:54:44.969908 close(23) = 0 <0.000030> 08:54:44.969979 writev(8, [{"[pid: 26800|app: 0|req: 113094/1"..., 208}], 1) = 208 <0.000027> 08:54:44.970106 epoll_ctl(11, EPOLL_CTL_ADD, 15, {EPOLLIN, {u32=15, u64=25383256719375}}) = 0 <0.000022> 08:54:44.970179 epoll_wait(11, [{EPOLLIN, {u32=10, u64=4294967306}}, {EPOLLIN, {u32=15, u64=25383256719375}}], 64, 4777) = 2 <0.000018> 08:54:44.970242 accept4(10, {sa_family=AF_INET, sin_port=htons(53598), sin_addr=inet_addr("192.168.150.158")}, [16], SOCK_NONBLOCK) = 23 <0.000022> 08:54:44.970326 read(15, "GET / HTTP/1.0\r\nConnection: Keep"..., 16384) = 105 <0.000022> 08:54:44.971013 write(2, "[TRACE][c8da4f8a]\n\t0 - 0.000477("..., 136) = 136 <0.000045> 08:54:44.971156 writev(15, [{"HTTP/1.0 404 Not Found\r\ncontent-"..., 67}, {"Not found", 9}], 2) = 76 <0.000034> 08:54:44.971252 close(15) = 0 <0.000029> 08:54:44.971328 writev(8, [{"[pid: 26800|app: 0|req: 113095/1"..., 208}], 1) = 208 <0.000026> Usage of cores is very low: $ zcat -f /var/log/uwsgi/app/combiner.access.log | perl -nE '/core (\d+)/ && say $1' | sort | uniq -c | wc -l 18 $ zcat -f /var/log/uwsgi/app/combiner.access.log.1 | perl -nE '/core (\d+)/ && say $1' | sort | uniq -c | wc -l 77 Do you have any ideas on what may cause this? Ideas on debugging it further? -- Руслан Закиров Руководитель отдела разработки веб-сервисов +7(916) 597-92-69, ruz @ <http://www.sports.ru/>
_______________________________________________ uWSGI mailing list uWSGI@lists.unbit.it http://lists.unbit.it/cgi-bin/mailman/listinfo/uwsgi
