Re: [squid-users] High CPU usage and degraded service time after 2 weeks of activity

2008-06-17 Thread Guillaume Smet
Tony, On Mon, Jun 16, 2008 at 7:31 PM, Anthony Tonns <[EMAIL PROTECTED]> wrote: > Did you ever find a resolution to this issue? I'm running a very similar > config and running into very similar problems - only on more servers > using more memory and the "RHEL" squid package on CentOS 5 x86_64. Sam

Re: [squid-users] High CPU usage and degraded service time after 2 weeks of activity

2008-06-16 Thread Adrian Chadd
On Mon, Jun 16, 2008, Anthony Tonns wrote: > CentOS is Linux ;-) so I will look into getting oprofile setup in our > sandbox environment and hammering away as a first step. Ok. > Also, what do you consider "lots" of regex rules? I have about 20 or so > rules that match on req_header with a regex

RE: [squid-users] High CPU usage and degraded service time after 2 weeks of activity

2008-06-16 Thread Anthony Tonns
> Are you using lots of regular expression rules? > Is this under Linux? > > The wikipedia guys had a big problem with gnumalloc + regex rules causing > Squid to degrade much like how you've said. > > You should be able to install the oprofile profiling suite in Centos/RHEL; > I suggest doing tha

Re: [squid-users] High CPU usage and degraded service time after 2 weeks of activity

2008-06-16 Thread Adrian Chadd
t; Thanks, > Tony > > > -Original Message- > > From: Guillaume Smet [mailto:[EMAIL PROTECTED] > > Sent: Tuesday, February 26, 2008 2:35 PM > > To: squid-users@squid-cache.org > > Cc: [EMAIL PROTECTED]; [EMAIL PROTECTED] > > Subject: [squid-users]

RE: [squid-users] High CPU usage and degraded service time after 2 weeks of activity

2008-06-16 Thread Anthony Tonns
ume Smet [mailto:[EMAIL PROTECTED] > Sent: Tuesday, February 26, 2008 2:35 PM > To: squid-users@squid-cache.org > Cc: [EMAIL PROTECTED]; [EMAIL PROTECTED] > Subject: [squid-users] High CPU usage and degraded service time after 2 > weeks of activity > > Hi squid-users, > &g

Re: [squid-users] High CPU usage and degraded service time after 2 weeks of activity

2008-02-26 Thread Guillaume Smet
On Wed, Feb 27, 2008 at 12:22 AM, leongmzlist <[EMAIL PROTECTED]> wrote: > What is the swap usage? I once had the same problem w/ squid > degrading over time. I had to reduce the cache_mem from 2GB to > 512MB, and reduce the amount of objects in the cache since the index > was growing too big.

Re: [squid-users] High CPU usage and degraded service time after 2 weeks of activity

2008-02-26 Thread leongmzlist
What is the swap usage? I once had the same problem w/ squid degrading over time. I had to reduce the cache_mem from 2GB to 512MB, and reduce the amount of objects in the cache since the index was growing too big. mike At 11:35 AM 2/26/2008, Guillaume Smet wrote: Hi squid-users, We recen

[squid-users] High CPU usage and degraded service time after 2 weeks of activity

2008-02-26 Thread Guillaume Smet
Hi squid-users, We recently experienced a problem on our new Squid setup (2 Squid servers configured as reverse proxy - mostly the same configuration as before except we allocated more memory and disk on the new servers - the old boxes didn't have this problem). After 2 weeks of very good performa

Re: [squid-users] High CPU usage when cache full

2007-11-27 Thread John Moylan
Hi, I don't have any scientific metrics regarding mem cache versus disk and cache, apart from metrics collected by keynote.com which show a slight inprovment in overall site speed which may or may not be related.. I had been using both memory and disk until fairly recently but feel I should have

Re: [squid-users] High CPU usage when cache full

2007-11-26 Thread Tek Bahadur Limbu
Hi John, John Moylan wrote: Hi, I have three memory only caches set up 7GB of memory each (the machines have 12GB of physical memory each). Throughput is fairly high and this setup works well in reducing the number of requests for smaller files from my backend storage with lower latency that a

[squid-users] High CPU usage when cache full

2007-11-26 Thread John Moylan
Hi, I have three memory only caches set up 7GB of memory each (the machines have 12GB of physical memory each). Throughput is fairly high and this setup works well in reducing the number of requests for smaller files from my backend storage with lower latency that a disk and mem. solution. However

RE: [squid-users] High CPU usage for large object

2007-08-09 Thread NGUYEN, KHANH, ATTSI
has it so that apache can serve it too. Thanks, Khanh -Original Message- From: Henrik Nordstrom [mailto:[EMAIL PROTECTED] Sent: Thursday, August 09, 2007 6:51 AM To: NGUYEN, KHANH, ATTSI Cc: squid-users@squid-cache.org Subject: Re: [squid-users] High CPU usage for large object On tis

Re: [squid-users] High CPU usage for large object

2007-08-09 Thread Henrik Nordstrom
On tis, 2007-08-07 at 13:25 -0400, NGUYEN, KHANH, ATTSI wrote: > So perhaps the squid has some extra overhead. However, 3 times more > seems unusual 3 times more is probably quite right for disk hits. Apache uses sendfile() while Squid reads in the object from disk to write it out again on the s

Re: [squid-users] High CPU usage for large object

2007-08-07 Thread Adrian Chadd
The place to start is grabbing traces from a running system to find out where the time is being spent. You'll probably want to start with vmstat and see whether its chewing 100% of one CPU, or whether its blocked waiting for disk IO, or a combination of the two. Its probably CPU - I'd then run op

[squid-users] High CPU usage for large object

2007-08-07 Thread NGUYEN, KHANH, ATTSI
Hi, I am using squid 2.6 on Linux AS version 4, update 3. Hardware: dell 2850, 4 GB memory, 6 x 72 GB disks. NO RAID. Each disk is one mount point. Squid basic configuration: cache_mem: 2 GB maximum_object_size 5096 MB maximum_object_size_in_memory 100 MB cache_replacement_policy lru 6 cache

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-02-01 Thread Alexandre Correa
remove support for dl-malloc !! enable epoll !! --disable-useragent-log --disable-referer-log --with-pthreads --enable-async-io --disable-dlmalloc --with-aio --enable-epoll regards, Alexandre J. Correa Onda Internet www.ondainternet.com.br On 1/30/07, Adrian Chadd <[EMAIL PROTECTED]> wrote:

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-30 Thread Adrian Chadd
On Tue, Jan 30, 2007, Michel Santos wrote: > But if you don't switch to SCSI I believe you do not get lucky with any. > Dont forget most of disk io for IDE/Sata is done by the CPU, so may be > your machine get stucked here, the CPU tries and runs to death since the > disk can not handle it. Thats

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-30 Thread Adrian Chadd
On Tue, Jan 30, 2007, Jason Taylor wrote: > Are you logging access_log to syslog? > I used to have "access_log syslog" in my squid.conf and just turned it off. > I saw my iowait drop from 46% to 1% within 10 seconds. This seems to be an artifact of Squid's synchronous logging code. (And, in your c

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-30 Thread Jason Taylor
Are you logging access_log to syslog? I used to have "access_log syslog" in my squid.conf and just turned it off. I saw my iowait drop from 46% to 1% within 10 seconds. /Jason Andrew Miehs wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 30/01/2007, at 8:51 PM, Robert wrote: My connecti

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-30 Thread Michel Santos
Robert disse na ultima mensagem: >> > My connection speed is 45 Mbit max, but real traffic is about 30-35 Mbit > including P2P. >> hey, now it is an interesting matter, so you may have 10-15Mb/s as http traffic here, may be some more sometimes doyou do NAt on this box? Or any fwd rules? or is it

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-30 Thread Michel Santos
Andrew Miehs disse na ultima mensagem: > > Top on linux/ (at least on debian) only shows one cpu (an average > over all 4 in this case). > I'll better be quiet because I really do not know much about Linux, but I believe redhat top also shows a CPU column like BSD, where you see the CPUID of each

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-30 Thread Andrew Miehs
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 30/01/2007, at 8:51 PM, Robert wrote: My connection speed is 45 Mbit max, but real traffic is about 30-35 Mbit including P2P. I am not really sure how high the interrupts are allowed to go... 20:33:10 CPU %user %nice%sys %iowait

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-30 Thread Robert
Andrew Miehs napisał(a): Hi Robert, This box seems to be running something a little MORE than squid - could this be a firewall perhaps? Yes it is iptables firewall, The huge number of interrupts then seem ok for this sort of a setup - How many Megabits/ second are you pushing through this bo

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-30 Thread Andrew Miehs
Hi Michel On 30/01/2007, at 8:06 PM, Michel Santos wrote: he said in an older msg that is a dual-xeon but the CPU column is not in top (the one he sent) so probably his OS is not SMP enabled I had read that - was just wondering due to the name he picked for his machine... Linux sunfir

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-30 Thread Michel Santos
Andrew Miehs disse na ultima mensagem: > > Is this box really an Intel box, or does it have Opterons installed? > (hostname name = sunfire) > he said in an older msg that is a dual-xeon but the CPU column is not in top (the one he sent) so probably his OS is not SMP enabled Michel ...

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-30 Thread Andrew Miehs
Hi Robert, This box seems to be running something a little MORE than squid - could this be a firewall perhaps? The huge number of interrupts then seem ok for this sort of a setup - How many Megabits/ second are you pushing through this box?! Sorry to be a pain - I have more quesions... Is

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-30 Thread Itzcak Pechtalt
cache_dir diskd /cache/cache1 1000 2 256 Q1=64 Q2=72 Your configuration for L1 in cache_dir is 2, it seems to be too low. By default it's 64, Henrik wrote in another mail here the following: - L1 value: cache_dir/416 (old post from Henrik) cache_dir/500 (other post read here) cache_dir/

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-30 Thread Andrew Miehs
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi Robert, Could you provide output from: uname -a uptime cat /proc/stat I am not a big fan of top - as the output can be very confusing to read. How many processors are in this box? Hyperthreading? (We will see this in /proc/

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-30 Thread Robert
When top shows cpu usage between 70-99% command vmstat 5 shows: procs ---memory-- ---swap-- -io --system-- cpu r b swpd free buff cache si sobibo incs us sy id wa 3 0 2572 52232 200152 27469200 3 31 0 2 13 8

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-30 Thread Michel Santos
Adrian Chadd disse na ultima mensagem: > I've started to flesh out a "how to profile Squid" section in the Squid > FAQ: > > http://wiki.squid-cache.org/SquidFaq/SquidProfiling > > See if there's anything there that helps you out. Check for disk and CPU > usage, > consider running oprofile and iden

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-30 Thread Adrian Chadd
I've started to flesh out a "how to profile Squid" section in the Squid FAQ: http://wiki.squid-cache.org/SquidFaq/SquidProfiling See if there's anything there that helps you out. Check for disk and CPU usage, consider running oprofile and identify where all the CPU use is going. Thanks, Adrian

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-30 Thread Robert
Adrian Chadd napisał(a): On Mon, Jan 29, 2007, Robert wrote: OK i recompiled squid with options: Squid Cache: Version 2.6.STABLE9 configure options: '--enable-storeio=diskd,aufs' '--enable-removal-policies=heap' '--disable-wccp' '--enable-arp-acl' '--enable-cache-digests' '--enable-default-

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-29 Thread Adrian Chadd
On Mon, Jan 29, 2007, Robert wrote: > OK i recompiled squid with options: > Squid Cache: Version 2.6.STABLE9 > configure options: '--enable-storeio=diskd,aufs' > '--enable-removal-policies=heap' '--disable-wccp' '--enable-arp-acl' > '--enable-cache-digests' '--enable-default-err-language=Polish'

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-29 Thread Craig Van Tassle
Agung T. Apriyanto wrote: > any large acl usage perhaps ? Or any large Regex acl's. I have found that on my proxy, with ntlm_auth and about 2mb of Regex ACL's I chew up about 1GB of ram and stick at about 20-30% CPU usage. I tried a LARGE acl but that chewed up all the Ram on my server and Sent the

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-29 Thread Agung T. Apriyanto
--- Robert <[EMAIL PROTECTED]> wrote: > > Linux top command show load oabout 60-99% and is > visible latency with > browsing sites, > any large acl usage perhaps ? -a3 Any questions? Get answers on any to

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-29 Thread Andrew Miehs
Dear Robert, what does vmstat 5 show? Please do not confuse 'Load' with CPU Time. Regards Andrew On 29/01/2007, at 3:47 PM, Robert wrote: Linux top command show load oabout 60-99% and is visible latency with browsing sites, Cache information for squid: Request Hit Ratios:

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-29 Thread Robert
OK i recompiled squid with options: Squid Cache: Version 2.6.STABLE9 configure options: '--enable-storeio=diskd,aufs' '--enable-removal-policies=heap' '--disable-wccp' '--enable-arp-acl' '--enable-cache-digests' '--enable-default-err-language=Polish' '--enable-linux-netfilter' '--disable-ident-

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-28 Thread Adrian Chadd
On Sun, Jan 28, 2007, Michel Santos wrote: > > Itzcak Pechtalt disse na ultima mensagem: > > There is some problem, Squid carries much more with low CPU. > > > > you probably shouldn't compile this options: > > > '--enable-kill-parent-hack' '--enable-dlmalloc' > > '--enable-xmalloc-statistics'

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-28 Thread Michel Santos
Itzcak Pechtalt disse na ultima mensagem: > There is some problem, Squid carries much more with low CPU. > you probably shouldn't compile this options: > '--enable-kill-parent-hack' '--enable-dlmalloc' > '--enable-xmalloc-statistics' '--enable-epoll' '--with-pthreads' > '--disable-poll' '--disa

Re: [squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-28 Thread Itzcak Pechtalt
There is some problem, Squid carries much more with low CPU. What is your OS ? Maybe it doesn't support epoll ? Itzcak On 1/28/07, Robert <[EMAIL PROTECTED]> wrote: Hello i have problem with high cpu usage and browsing latency (now browsing sites without squid if faster than with squid enable

[squid-users] High CPU usage problem on Squid 2.6 STABLE9

2007-01-28 Thread Robert
Hello i have problem with high cpu usage and browsing latency (now browsing sites without squid if faster than with squid enabled), i have 3 SCSI disk in configuration: cache_dir diskd /cache/cache1 1000 2 256 Q1=64 Q2=72 cache_dir diskd /cache/cache2 1000 2 256 Q1=64 Q2=72 cache_dir diskd /cac

Re: [squid-users] High CPU usage

2004-10-22 Thread Thomas-Martin Seck
* Russ Uhte ([EMAIL PROTECTED]): > Russ Uhte wrote: > >MB. Everything was running smooth until this morning around 10:00a.m. > >At this time, the CPU pegged out at 100%, so I restarted squid. I then > >watched squid climb back up to 100%. Every once in a while, it will > >start to climb back

Re: [squid-users] High CPU usage

2004-10-20 Thread Russ Uhte
Russ Uhte wrote: I've done a lot of reading, and I can't seem to figure out what's going on. OS FreeBSD 4.10-RELEASE-p2. Squid is Version 2.5.STABLE6. There are 4 15k 18GB drives being used for the cache. It has a 3.0 GHz HT Intel processor, and 2 GB of RAM. This install has been running sin

[squid-users] High CPU usage

2004-10-20 Thread Russ Uhte
I've done a lot of reading, and I can't seem to figure out what's going on. OS FreeBSD 4.10-RELEASE-p2. Squid is Version 2.5.STABLE6. There are 4 15k 18GB drives being used for the cache. It has a 3.0 GHz HT Intel processor, and 2 GB of RAM. This install has been running since Monday. I not

[squid-users] High cpu usage

2004-08-23 Thread unixware
Dear all my squid performance is slugglish due to High CPU usage . sometime squid take 99.9 cpu usage in top command output. My server spec as follow: Pentitum III 1200 Mhz (on intel Server Board) 2 GB RAM 2 SCSI Disk ( 4 GB cache dir ) OS Redhat 9 squid configuration option async-io filesy