[squid-users] Re: high memory usage (squid 3.2.0)

2013-08-10 Thread Dash Four


Mr Dash Four wrote:
I have the following settings in my squid.conf file relating to the 
memory usage:


cache_mem 200 MB
maximum_object_size_in_memory 512 KB

cache_replacement_policy heap GDSF
memory_replacement_policy heap GDSF
cache_dir diskd /var/spool/squid 200 16 256
cache_swap_high 100%
cache_swap_low 80%


The system is atom-based machine with 2GB memory. Even though squid 
starts OK at first, it gradually baloons and the current memory usage 
(according to ps) is:


root 14000  0.0  0.1  15868  2420 ?Ss   Feb02   0:00 squid 
-f /etc/squid/squid.conf
__squid  14003  0.2 65.3 1356920 1344848 ? SFeb02 162:04 
(squid-1) -f /etc/squid/squid.conf
__squid  14004  0.0  0.0   3636   552 ?SFeb02   0:00 
(unlinkd)
__squid  14006  0.0  0.0   4164   752 ?SFeb02   2:16 diskd 
14339076 14339077 14339078
The above was with squid 3.2.0 and made after about a month of continues 
squid use. The following is with squid 3.3.4 and made after more than 48 
days of such use:


cache_mem 200 MB
maximum_object_size_in_memory 512 KB

cache_replacement_policy heap GDSF
memory_replacement_policy heap GDSF
cache_dir diskd /var/spool/squid 300 16 256
cache_swap_high 100
cache_swap_low 80

root  2904  0.0  0.1  16484  2576 ?Ss   Jun22   0:00 squid 
-f /etc/squid/squid.conf
__squid 2906  0.2  4.4 105088 90896 ?SJun22 190:57 
(squid-1) -f /etc/squid/squid.conf

__squid 2908  0.0  0.0   3668   708 ?SJun22   0:00 (unlinkd)
__squid 2909  0.0  0.0   4192   968 ?SJun22   2:43 diskd 
2975748 2975749 2975750



The above, I think, speaks for itself - quite a difference!


[squid-users] Re: high memory usage (squid 3.2.0)

2013-04-10 Thread babajaga
Il 09/04/2013 19:33, Mr Dash Four ha scritto:
  [snip]
if the maximum_object_size_in_memory is reduced,
 then I suppose squid's memory footprint will have to go down too, which
 makes the cache_mem option a bit useless.

I think will just store more objects in RAM. 

Agreed.
But it should also depend upon
# reply_body_max_size 0
#read_ahead_gap

Setting reply_body_max_size 100 MB 
should create some safety net. 



--
View this message in context: 
http://squid-web-proxy-cache.1019090.n4.nabble.com/high-memory-usage-squid-3-2-0-tp4659422p4659441.html
Sent from the Squid - Users mailing list archive at Nabble.com.


[squid-users] Re: high memory usage (squid 3.2.0)

2013-04-10 Thread M A Young

On Tue, 9 Apr 2013, Mr Dash Four wrote:

The system is atom-based machine with 2GB memory. Even though squid starts OK 
at first, it gradually baloons and the current memory usage (according to ps) 
is:


Older versions of squid 3 do have some known memory leaks which might be 
your problem here, so I suggest you upgrade to a current version of squid 
such as 3.3.3 or 3.2.9.


Michael Young


Re: [squid-users] Re: high memory usage (squid 3.2.0)

2013-04-10 Thread Ralf Hildebrandt
* M A Young m.a.yo...@durham.ac.uk:
 On Tue, 9 Apr 2013, Mr Dash Four wrote:
 
 The system is atom-based machine with 2GB memory. Even though squid
 starts OK at first, it gradually baloons and the current memory
 usage (according to ps) is:
 
 Older versions of squid 3 do have some known memory leaks which might
 be your problem here, so I suggest you upgrade to a current version
 of squid such as 3.3.3 or 3.2.9.

Amen to that. It got A LOT better.

-- 
Ralf Hildebrandt   Charite Universitätsmedizin Berlin
ralf.hildebra...@charite.deCampus Benjamin Franklin
http://www.charite.de  Hindenburgdamm 30, 12203 Berlin
Geschäftsbereich IT, Abt. Netzwerk fon: +49-30-450.570.155


signature.asc
Description: Digital signature


[squid-users] Re: high memory usage (squid 3.2.0)

2013-04-10 Thread babajaga
Amen to that. It got A LOT better.

Interesting. Any facts available about mem leaks in 2.7 final, at least ?
I am still using it, not recognizing a leak. Which might be caused to
non-default configs only, though.







--
View this message in context: 
http://squid-web-proxy-cache.1019090.n4.nabble.com/high-memory-usage-squid-3-2-0-tp4659422p4659446.html
Sent from the Squid - Users mailing list archive at Nabble.com.


[squid-users] Re: high memory usage (squid 3.2.0)

2013-04-10 Thread Mr Dash Four



M A Young wrote:

On Tue, 9 Apr 2013, Mr Dash Four wrote:

The system is atom-based machine with 2GB memory. Even though squid 
starts OK at first, it gradually baloons and the current memory usage 
(according to ps) is:


Older versions of squid 3 do have some known memory leaks which might 
be your problem here, so I suggest you upgrade to a current version of 
squid such as 3.3.3 or 3.2.9.

This was my plan B if nothing else works.


Re: [squid-users] Re: high memory usage (squid 3.2.0)

2013-04-10 Thread Marcello Romani

Il 10/04/2013 10:20, Ralf Hildebrandt ha scritto:

* M A Young m.a.yo...@durham.ac.uk:

On Tue, 9 Apr 2013, Mr Dash Four wrote:


The system is atom-based machine with 2GB memory. Even though squid
starts OK at first, it gradually baloons and the current memory
usage (according to ps) is:


Older versions of squid 3 do have some known memory leaks which might
be your problem here, so I suggest you upgrade to a current version
of squid such as 3.3.3 or 3.2.9.


Amen to that. It got A LOT better.



FWIW, my squid 3.1.6 memory usage started to grow indefinitely when I 
set cache_mem to 1024 MB (however it works well with the default value 
of 256 MB, which is fine for my current needs).


--
Marcello Romani


[squid-users] Re: high memory usage (squid 3.2.0)

2013-04-10 Thread babajaga
What currently seems to happen is that cache_mem is completely ignored 
and squid is trying to shove up as many objects into my ram as possible, 

Not exactly.
You might be a victim of max_object_size, as I mentionead already above.
squid will store a 500MB video temporarily in mem, unles you put some cap on
that.
Look at access.log, whether you can find such large objects.




--
View this message in context: 
http://squid-web-proxy-cache.1019090.n4.nabble.com/high-memory-usage-squid-3-2-0-tp4659422p4659468.html
Sent from the Squid - Users mailing list archive at Nabble.com.