Re: [squid-users] Squid at 100% CPU with 10 minutes period
fedorischev wrote: В сообщении от Monday 07 December 2009 13:00:22 Amos Jeffries написал(а): fedorischev wrote: Several days ago I find, that Squid3.0STABLE16 eating CPU time by HTTP method CONNECT while request is hitting delay pool. I'm looking for the spare time to post more debugging info on the list. WBR. Please try 3.0.STABLE20 and confirm that the problem still exists. There are a few hang and infinite loop errors resolved since *16. Some rather nasty remote DDoS security issues as well. Amos OK, thank you for tip. I'll try to use 3.0STABLE20 & post the results on the list immediately. Now I'm looking for the linux http downloader software, that may using CONNECT - for squid testing purposes. Unfortunately - no results as yet :) WBR. I have not tested this, but from a quick check of the code its should work: squidclient -m CONNECT -P file host:port If you create a fake HTTP request and store the request headers in "file" the above should send a CONNECT request for "host:port" to Squid then pass the contents of "file" through the tunnel same as a downloader would. The only difference from a regular CONNECT is that squidclient will add a Content-Length: header which do not usually go on CONNECT requests due to their unpredictable nature. Amos -- Please be using Current Stable Squid 2.7.STABLE7 or 3.0.STABLE20 Current Beta Squid 3.1.0.15
Re: [squid-users] Squid at 100% CPU with 10 minutes period
В сообщении от Monday 07 December 2009 13:00:22 Amos Jeffries написал(а): > fedorischev wrote: > > Several days ago I find, that Squid3.0STABLE16 eating CPU time by HTTP > > method CONNECT while request is hitting delay pool. I'm looking for the > > spare time to post more debugging info on the list. > > > > WBR. > > Please try 3.0.STABLE20 and confirm that the problem still exists. > There are a few hang and infinite loop errors resolved since *16. Some > rather nasty remote DDoS security issues as well. > > Amos OK, thank you for tip. I'll try to use 3.0STABLE20 & post the results on the list immediately. Now I'm looking for the linux http downloader software, that may using CONNECT - for squid testing purposes. Unfortunately - no results as yet :) WBR.
Re: [squid-users] Squid at 100% CPU with 10 minutes period
fedorischev wrote: В сообщении от Friday 04 December 2009 23:51:28 Guy Bashkansky написал(а): Hi, The problem: on a certain origin content, Squid reaches 100% CPU periodically, every 10 minutes, so the cache service suffers. Any clues where to look? Maybe this problem and its solution are known? The CPU load pattern is something like this, minute-by-minute: 40%, 40%, 60%, 80%, 99%, 99%, 99%, 80%, 60%, 40%, repeat. Thanks, Guy Several days ago I find, that Squid3.0STABLE16 eating CPU time by HTTP method CONNECT while request is hitting delay pool. I'm looking for the spare time to post more debugging info on the list. WBR. Please try 3.0.STABLE20 and confirm that the problem still exists. There are a few hang and infinite loop errors resolved since *16. Some rather nasty remote DDoS security issues as well. Amos -- Please be using Current Stable Squid 2.7.STABLE7 or 3.0.STABLE20 Current Beta Squid 3.1.0.15
Re: [squid-users] Squid at 100% CPU with 10 minutes period
В сообщении от Friday 04 December 2009 23:51:28 Guy Bashkansky написал(а): > Hi, > > The problem: on a certain origin content, Squid reaches 100% CPU > periodically, every 10 minutes, so the cache service suffers. > > Any clues where to look? Maybe this problem and its solution are known? > > The CPU load pattern is something like this, minute-by-minute: > 40%, 40%, 60%, 80%, 99%, 99%, 99%, 80%, 60%, 40%, repeat. > > Thanks, > Guy Several days ago I find, that Squid3.0STABLE16 eating CPU time by HTTP method CONNECT while request is hitting delay pool. I'm looking for the spare time to post more debugging info on the list. WBR.
Re: [squid-users] Squid at 100% CPU with 10 minutes period
Guy Bashkansky wrote: Amos, thanks for the links. I've looked at the mailing list and the open bugs, and could not find something similar to what I see, with the 10 minutes period. We're using a customized version of Squid 2.4 STABLE6, and it's not in my power to upgrade it to any later version... It runs on FreeBSD 6.2-RELEASE-p9 amd64 servers. I know I need some profiling/debugging information to determine where CPU spends its cycles, but on these servers most usual tools are either absent or not working very well: There's no 'oprofile' for FreeBSD, 'pmcstat' fails to run (no lib?), 'gprof' does not give info beyond parseConfigFile() even in my custom profiling-enabled version with -N, 'gdb' does not recognize debug info, and 'strace' is not installed. I've found 'truss' command to be working and traced system calls made by the squid process, trying to recognize some patterns -- noticed that during CPU load spike write() sometimes returns EPIPE, 'Broken pipe'. Does my version (2.4 STABLE6) ring any bells? Sorry, 2.4 was ancient history when I joined the project. All I know about it is the list of features added that release. Amos -- Please be using Current Stable Squid 2.7.STABLE7 or 3.0.STABLE20 Current Beta Squid 3.1.0.15
Re: [squid-users] Squid at 100% CPU with 10 minutes period
Amos, thanks for the links. I've looked at the mailing list and the open bugs, and could not find something similar to what I see, with the 10 minutes period. We're using a customized version of Squid 2.4 STABLE6, and it's not in my power to upgrade it to any later version... It runs on FreeBSD 6.2-RELEASE-p9 amd64 servers. I know I need some profiling/debugging information to determine where CPU spends its cycles, but on these servers most usual tools are either absent or not working very well: There's no 'oprofile' for FreeBSD, 'pmcstat' fails to run (no lib?), 'gprof' does not give info beyond parseConfigFile() even in my custom profiling-enabled version with -N, 'gdb' does not recognize debug info, and 'strace' is not installed. I've found 'truss' command to be working and traced system calls made by the squid process, trying to recognize some patterns -- noticed that during CPU load spike write() sometimes returns EPIPE, 'Broken pipe'. Does my version (2.4 STABLE6) ring any bells? On Sat, Dec 5, 2009 at 3:33 AM, Amos Jeffries wrote: > > Guy Bashkansky wrote: >> >> Amos, >> >> Where can I find a list of the solved "Squid uses 100% CPU" bugs? It >> would help me figure out which one I may be experiencing. > > Sorry for being gruff. > > The mailing list queries: > http://squid.markmail.org/search/?q=squid+uses+100%25+cpu > > The remaining open bugs mentioning > http://bugs.squid-cache.org/buglist.cgi?quicksearch=100%25+CPU > > The closed ones are hard to find as they have been re-named to say what the > actual problems was. > > > Which release and version of squid is this? > >> >> When I attach gdb to the running squid process, it does not find >> debugging info, despite compiling with -g flag (maybe a gdb setup >> problem, nm does show symbols). >> >> When I try to use gprof for profiling (squid compiled with -pg), >> squid.gmon contains only the initial configuration functions >> profiling. I stop squid with -k shutdown signal so it exits normally >> (which is necessary to produce squid.gmon). > > Squid needs to be started with -N to prevent forking a child daemon that does > all the actual work. The main process can then be traced. > > Amos > -- > Please be using > Current Stable Squid 2.7.STABLE7 or 3.0.STABLE20 > Current Beta Squid 3.1.0.15
Re: [squid-users] Squid at 100% CPU with 10 minutes period
Guy Bashkansky wrote: Amos, Where can I find a list of the solved "Squid uses 100% CPU" bugs? It would help me figure out which one I may be experiencing. Sorry for being gruff. The mailing list queries: http://squid.markmail.org/search/?q=squid+uses+100%25+cpu The remaining open bugs mentioning http://bugs.squid-cache.org/buglist.cgi?quicksearch=100%25+CPU The closed ones are hard to find as they have been re-named to say what the actual problems was. Which release and version of squid is this? When I attach gdb to the running squid process, it does not find debugging info, despite compiling with -g flag (maybe a gdb setup problem, nm does show symbols). When I try to use gprof for profiling (squid compiled with -pg), squid.gmon contains only the initial configuration functions profiling. I stop squid with -k shutdown signal so it exits normally (which is necessary to produce squid.gmon). Squid needs to be started with -N to prevent forking a child daemon that does all the actual work. The main process can then be traced. Amos -- Please be using Current Stable Squid 2.7.STABLE7 or 3.0.STABLE20 Current Beta Squid 3.1.0.15
Re: [squid-users] Squid at 100% CPU with 10 minutes period
Amos, Where can I find a list of the solved "Squid uses 100% CPU" bugs? It would help me figure out which one I may be experiencing. When I attach gdb to the running squid process, it does not find debugging info, despite compiling with -g flag (maybe a gdb setup problem, nm does show symbols). When I try to use gprof for profiling (squid compiled with -pg), squid.gmon contains only the initial configuration functions profiling. I stop squid with -k shutdown signal so it exits normally (which is necessary to produce squid.gmon). Guy On Fri, Dec 4, 2009 at 3:47 PM, Amos Jeffries wrote: > > We have solved many "Squid uses 100% CPU" bugs. There are others probably > still present. Which one are you talking about? > > http://wiki.squid-cache.org/SquidFaq/BugReporting > > Amos > -- > Please be using > Current Stable Squid 2.7.STABLE7 or 3.0.STABLE20 > Current Beta Squid 3.1.0.15 >
Re: [squid-users] Squid at 100% CPU with 10 minutes period
Guy Bashkansky wrote: Hi, The problem: on a certain origin content, Squid reaches 100% CPU periodically, every 10 minutes, so the cache service suffers. Any clues where to look? Maybe this problem and its solution are known? The CPU load pattern is something like this, minute-by-minute: 40%, 40%, 60%, 80%, 99%, 99%, 99%, 80%, 60%, 40%, repeat. Thanks, Guy We have solved many "Squid uses 100% CPU" bugs. There are others probably still present. Which one are you talking about? http://wiki.squid-cache.org/SquidFaq/BugReporting Amos -- Please be using Current Stable Squid 2.7.STABLE7 or 3.0.STABLE20 Current Beta Squid 3.1.0.15
[squid-users] Squid at 100% CPU with 10 minutes period
Hi, The problem: on a certain origin content, Squid reaches 100% CPU periodically, every 10 minutes, so the cache service suffers. Any clues where to look? Maybe this problem and its solution are known? The CPU load pattern is something like this, minute-by-minute: 40%, 40%, 60%, 80%, 99%, 99%, 99%, 80%, 60%, 40%, repeat. Thanks, Guy
