[squid-users] High Memory Usage

2007-07-02 Thread Sekar
Hello All, I have a list of urls to be blocked in a text file and the size of it is 4MB. Squid has been configured to use this to match the requested urls and configuration is given below. acl blocked url_regex '/usr/local/squid/blocked.txt' http_access deny blocked This is working perfectly

Re: [squid-users] High Memory Usage

2007-07-02 Thread Tek Bahadur Limbu
Sekar wrote: Hello All, I have a list of urls to be blocked in a text file and the size of it is 4MB. Squid has been configured to use this to match the requested urls and configuration is given below. Hi Sekar, A text file of size 4 MB! It must contain at least 30 thousand entries. acl

Re: [squid-users] High Memory Usage

2007-07-02 Thread Henrik Nordstrom
On Mon, 2007-07-02 at 23:56 +0545, Tek Bahadur Limbu wrote: > Using dstdomain in place of url_regex if applicable will probably reduce > your overall CPU usage. and memory usage.. regex is quite memory hungry.. Regards Henrik signature.asc Description: This is a digitally signed message part

[squid-users] high memory usage (squid 3.2.0)

2013-04-09 Thread Mr Dash Four
I have the following settings in my squid.conf file relating to the memory usage: cache_mem 200 MB maximum_object_size_in_memory 512 KB cache_replacement_policy heap GDSF memory_replacement_policy heap GDSF cache_dir diskd /var/spool/squid 200 16 256 cache_swap_high 100% cache_swap_low 80% Th

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-09 Thread Squidblacklist
With only 200mb available to the system I would turn the size in memory down to 64k or lower. - Signed, Fix Nichols http://www.squidblacklist.org

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-09 Thread Squidblacklist
On Tue, 09 Apr 2013 17:43:58 +0100 Mr Dash Four wrote: > I have the following settings in my squid.conf file relating to the > memory usage: > > cache_mem 200 MB > maximum_object_size_in_memory 512 KB > > cache_replacement_policy heap GDSF > memory_replacement_policy heap GDSF > cache_dir disk

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-09 Thread Mr Dash Four
Squidblacklist wrote: With only 200mb available to the system I would turn the size in memory down to 64k or lower. In other words change "maximum_object_size_in_memory 512 KB" to "maximum_object_size_in_memory 64 KB" or less? Is that what is causing this? The cache logs tell me this: Lo

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-09 Thread Mr Dash Four
I have the following settings in my squid.conf file relating to the memory usage: cache_mem 200 MB maximum_object_size_in_memory 512 KB cache_replacement_policy heap GDSF memory_replacement_policy heap GDSF cache_dir diskd /var/spool/squid 200 16 256 < 200kb? thats less than 1 mb

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-09 Thread Squidblacklist
Well you can have max cachemem object set to 512k, but only if you give it something reasonable like, 2GB of ram or more, as opposed to the 200mb it currently has. Because with it set to 512k its filling your ram up very quickly with large objects, if you insist on only allowing 200mb ram for squid

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-09 Thread Mr Dash Four
Squidblacklist wrote: Well you can have max cachemem object set to 512k, but only if you give it something reasonable like, 2GB of ram or more, as opposed to the 200mb it currently has. Because with it set to 512k its filling your ram up very quickly with large objects, if you insist on only al

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-09 Thread Squidblacklist
I believe I have seen similar issues before when users set the max ram and the disk size to the same exact settings, might I suggest you increase the storage available from 200mb to 300mb, and test. Its worth a shot. - Signed, Fix Nichols http://www.squidblacklist.org

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-09 Thread Mr Dash Four
Squidblacklist wrote: I believe I have seen similar issues before when users set the max ram and the disk size to the same exact settings, might I suggest you increase the storage available from 200mb to 300mb, and test. Its worth a shot. OK, I'll give it a go. Do I have to completely restar

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-09 Thread Marcello Romani
Il 09/04/2013 19:33, Mr Dash Four ha scritto: > [snip] if the maximum_object_size_in_memory is reduced, then I suppose squid's memory footprint will have to go down too, which makes the cache_mem option a bit useless. I think will just store more objects in RAM. -- Marcello Romani

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-10 Thread Mr Dash Four
Marcello Romani wrote: Il 09/04/2013 19:33, Mr Dash Four ha scritto: > [snip] if the maximum_object_size_in_memory is reduced, then I suppose squid's memory footprint will have to go down too, which makes the cache_mem option a bit useless. I think will just store more objects in RAM. I am

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-10 Thread Marcello Romani
Il 10/04/2013 13:59, Mr Dash Four ha scritto: Marcello Romani wrote: Il 09/04/2013 19:33, Mr Dash Four ha scritto: > [snip] if the maximum_object_size_in_memory is reduced, then I suppose squid's memory footprint will have to go down too, which makes the cache_mem option a bit useless. I th

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-10 Thread Marcello Romani
Il 10/04/2013 14:29, Marcello Romani ha scritto: Il 10/04/2013 13:59, Mr Dash Four ha scritto: Marcello Romani wrote: Il 09/04/2013 19:33, Mr Dash Four ha scritto: > [snip] if the maximum_object_size_in_memory is reduced, then I suppose squid's memory footprint will have to go down too, whic

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-10 Thread Squidblacklist
> > As an addition to my previous comment, please read this comment in > squid.conf (3.1.6 FWIW): > > # TAG: store_avg_object_size (kbytes) > # Average object size, used to estimate number of objects your > # cache can hold. > May I chime in? ^ That's an interesting directive that I ha

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-10 Thread Mr Dash Four
Marcello Romani wrote: Il 10/04/2013 13:59, Mr Dash Four ha scritto: Marcello Romani wrote: Il 09/04/2013 19:33, Mr Dash Four ha scritto: > [snip] if the maximum_object_size_in_memory is reduced, then I suppose squid's memory footprint will have to go down too, which makes the cache_mem

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-10 Thread Mr Dash Four
As an addition to my previous comment, please read this comment in squid.conf (3.1.6 FWIW): # TAG: store_avg_object_size (kbytes) # Average object size, used to estimate number of objects your # cache can hold. I don't see how this helps fixing the problem I described in my initial pos

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-10 Thread Alex Rousskov
On 04/10/2013 09:22 AM, Mr Dash Four wrote: > the total memory used of all objects placed in ram should > not be 6 times the cache_mem value There is no such rule or law of physics. cache_mem is not squid_mem (a not-yet-supported option that would limit total Squid memory usage). The total memor

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-10 Thread Mr Dash Four
Alex Rousskov wrote: On 04/10/2013 09:22 AM, Mr Dash Four wrote: the total memory used of all objects placed in ram should not be 6 times the cache_mem value There is no such rule or law of physics. cache_mem is not squid_mem (a not-yet-supported option that would limit total Squid

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-10 Thread Squidblacklist
Gentlemen, this exchange is not even close to being constructive, let us start over shall we. Please, give us your entire squid.conf and version, as well as your OS and Kernel version. - Signed, Fix Nichols http://www.squidblacklist.org

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-10 Thread Marcello Romani
Il 10/04/2013 17:22, Mr Dash Four ha scritto: the memory usage should be dependent on the cache_mem parameter (give or take a certain amount of memory needed for managing the disk cache) cache_mem doesn't specify the amount of memory needed for managing the disk cache. http://wiki.squid-cach

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-10 Thread Marcello Romani
Il 10/04/2013 17:22, Mr Dash Four ha scritto: As an addition to my previous comment, please read this comment in squid.conf (3.1.6 FWIW): # TAG: store_avg_object_size (kbytes) # Average object size, used to estimate number of objects your # cache can hold. I don't see how this helps fi

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-11 Thread Marcello Romani
Il 10/04/2013 17:22, Mr Dash Four ha scritto: Marcello Romani wrote: Il 10/04/2013 13:59, Mr Dash Four ha scritto: Marcello Romani wrote: Il 09/04/2013 19:33, Mr Dash Four ha scritto: > [snip] if the maximum_object_size_in_memory is reduced, then I suppose squid's memory footprint will ha

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-11 Thread Amos Jeffries
On 11/04/2013 7:11 p.m., Marcello Romani wrote: Il 10/04/2013 17:22, Mr Dash Four ha scritto: Marcello Romani wrote: Il 10/04/2013 13:59, Mr Dash Four ha scritto: Marcello Romani wrote: Il 09/04/2013 19:33, Mr Dash Four ha scritto: > [snip] if the maximum_object_size_in_memory is reduced

Re: [squid-users] high memory usage (squid 3.2.0)

2013-04-11 Thread Alex Rousskov
On 04/10/2013 03:37 PM, Mr Dash Four wrote: > Alex Rousskov wrote: >> The total memory used by Squid is, roughly: >> >>1) initial memory used by Squid shortly after start + >>2) memory used to store memory-cached objects + >>3a) memory used to index memory-cached objects + >>3b) mem

Re: [squid-users] high memory usage (squid 3.2.0)

2013-08-10 Thread Dash Four
Mr Dash Four wrote: Alex Rousskov wrote: On 04/10/2013 09:22 AM, Mr Dash Four wrote: the total memory used of all objects placed in ram should not be 6 times the cache_mem value There is no such rule or law of physics. cache_mem is not squid_mem (a not-yet-supported option that would

Re: [squid-users] high memory usage (squid 3.2.0)

2013-08-10 Thread Amos Jeffries
On 10/08/2013 11:22 p.m., Dash Four wrote: It needs to be noted that there is no (significant) differences in the configuration between the old and the new versions, apart from minor corrections to account for changed option names (transition from 3.2.0 to 3.3.4). There isn't any difference in