Re: [squid-users] memory usage

2017-10-06 Thread Amos Jeffries
On 06/10/17 20:04, Vieri wrote: Hi, On a Squid server I'm seeing how the buffer mem usage is steadily growing. You mean mem_node? or the "*K Buffers" entries? The mem_node is used by cache_mem entries, in-transit objects and some hot cache_dir index entries. So the value there need to be

Re: [squid-users] memory usage

2017-10-06 Thread Amos Jeffries
On 06/10/17 20:27, Vieri wrote: OK, I guess I'm starting to understand how Linux manages disk caching, and the meaning of "buffered". In fact: # free -m totalusedfree shared buff/cache available Mem: 3209427991074 154

[squid-users] memory usage

2017-10-06 Thread Vieri
OK, I guess I'm starting to understand how Linux manages disk caching, and the meaning of "buffered". In fact: # free -m totalusedfree shared buff/cache available Mem: 3209427991074 154 28220 28810 Swap: 36168

[squid-users] memory usage

2017-10-06 Thread Vieri
Hi, On a Squid server I'm seeing how the buffer mem usage is steadily growing. I'm running out of free memory. top - 08:34:25 up 37 days, 1:00, 2 users, load average: 1.39, 1.27, 1.36 Tasks: 340 total, 1 running, 339 sleeping, 0 stopped, 0 zombie %Cpu(s): 0.6 us, 0.2 sy, 0.0 ni,

Re: [squid-users] Memory leak

2017-08-21 Thread FUSTE Emmanuel
Le 19/08/2017 à 22:08, Eliezer Croitoru a écrit : > Hey Emmanuel, > > Something is not clear to me. > Are you using url_rewrite or store_id helpers in any form? No > Also what DNS lookups squid does exactly? > - Reverse > - Forward Mostly forward > > Also: > - internal clients > - external domains

Re: [squid-users] Memory leak (was: Squid 3.x never_direct and DNS requests problem.)

2017-08-19 Thread Eliezer Croitoru
-28704261 Email: elie...@ngtech.co.il -Original Message- From: squid-users [mailto:squid-users-boun...@lists.squid-cache.org] On Behalf Of FUSTE Emmanuel Sent: Friday, August 18, 2017 14:53 To: Amos Jeffries <squ...@treenet.co.nz>; squid-users@lists.squid-cache.org Subject: [squid-users]

[squid-users] Memory leak (was: Squid 3.x never_direct and DNS requests problem.)

2017-08-18 Thread FUSTE Emmanuel
Le 24/01/2017 à 10:55, FUSTE Emmanuel a écrit : > Le 23/01/2017 à 23:41, Amos Jeffries a écrit : >> On 24/01/2017 3:58 a.m., FUSTE Emmanuel wrote: >>> All was carefully checked and nothing in my configuration (acl etc ...) >>> explain why Squid insist to do DNS requests for requests forwarded to

Re: [squid-users] Memory usage question

2015-06-22 Thread Amos Jeffries
On 22/06/2015 5:28 p.m., Alex Samad wrote: Hi UFS or AUFS ? guessing aufs UFA, AUFS, diskd - all the same in this regard. Any suggestions on the L1 L2 values, defaults ? Not particularly. Though others may have preferences. AFAIK the FS directory index issues in ext2 that L1/L2 exist to

Re: [squid-users] Memory usage question

2015-06-21 Thread Alex Samad
Hi UFS or AUFS ? guessing aufs Any suggestions on the L1 L2 values, defaults ? On 21 June 2015 at 11:57, Amos Jeffries squ...@treenet.co.nz wrote: On 20/06/2015 9:08 p.m., Alex Samad wrote: Hi Are there any gotchas i need to look out for. Also I have allocated a 1T lun to the VM. Whats

Re: [squid-users] Memory usage question

2015-06-20 Thread Alex Samad
Hi Are there any gotchas i need to look out for. Also I have allocated a 1T lun to the VM. Whats the best way to allocate this do I use 1 cache_dir or multiple cache_dir. I currently have 3, is there a way to migrate the cache objects in the 3 into 1 or do I just delete them and bear the cost of

Re: [squid-users] Memory usage question

2015-06-20 Thread Amos Jeffries
On 20/06/2015 9:08 p.m., Alex Samad wrote: Hi Are there any gotchas i need to look out for. Also I have allocated a 1T lun to the VM. Whats the best way to allocate this do I use 1 cache_dir or multiple cache_dir. The usual one UFS based dir per physical drive and no RAID. That can be

Re: [squid-users] Memory usage question

2015-06-19 Thread Marcus Kool
What is the physical memory size ?? You might want to read the faq on memory: http://wiki.squid-cache.org/SquidFaq/SquidMemory Marcus On 06/19/2015 07:19 AM, Alex Samad wrote: Hi I recently push my squid VM memory up to 65G i pushed up squid usage (i thought) to 40G squid.conf cache_mem

Re: [squid-users] Memory usage question

2015-06-19 Thread Eliezer Croitoru
First goes first... Upgrade to 3.5 or 3.4 branch. Then try to use top or htop to get a snapshot of the virtual memory and resident memory that squid uses. Eliezer On 19/06/2015 13:19, Alex Samad wrote: this is on centos 6.6 still using the redhat build squid ! rpm -q squid

Re: [squid-users] Memory Leak Squid 3.4.9 on FreeBSD 10.0 x64

2015-01-15 Thread Eugene M. Zheganin
Hi. On 12.01.2015 19:06, Amos Jeffries wrote: I am confident that those types of leaks do not exist at al in Squid 3.4. These rounds of mmory exhaustion problems are caused by pseudo-leaks, where Squid incorrectly holds onto memory (has not forgotten it though) far longer than it should be.

Re: [squid-users] Memory Leak Squid 3.4.9 on FreeBSD 10.0 x64

2015-01-12 Thread Eugene M. Zheganin
Hi. On 09.01.2015 06:12, Amos Jeffries wrote: Grand total: = 9.5 GB of RAM just for Squid. .. then there is whatever memory the helper programs, other software on the server and operating system all need. I'm now also having a strong impression that squid is leaking memory. Now, when

Re: [squid-users] Memory Leak Squid 3.4.9 on FreeBSD 10.0 x64

2015-01-12 Thread Yuri Voinov
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Yep. Memory leaking - if it really it - will be occurs on all platforms. If not - this is OS-specific issue. libc, malloc library problem. But not squid itself. 12.01.2015 18:06, Eugene M. Zheganin пишет: Hi. On 12.01.2015 16:41, Eugene M.

Re: [squid-users] Memory Leak Squid 3.4.9 on FreeBSD 10.0 x64

2015-01-12 Thread Yuri Voinov
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Yep. Memory leaking - if it really it - will be occurs on all platforms. If not - this is OS-specific issue. libc, malloc library problem. But not squid itself. 12.01.2015 18:06, Eugene M. Zheganin пишет: -BEGIN PGP SIGNATURE- Version:

Re: [squid-users] Memory Leak Squid 3.4.9 on FreeBSD 10.0 x64

2015-01-12 Thread Yuri Voinov
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Looks like an OS-specific issue. I don't see any memory leaking on my boxes (running Solaris 10, yes ;)). Moreover, helpers is corrrectly got an release memory. 12.01.2015 17:41, Eugene M. Zheganin пишет: Hi. On 09.01.2015 06:12, Amos Jeffries

Re: [squid-users] Memory Leak Squid 3.4.9 on FreeBSD 10.0 x64

2015-01-12 Thread Eugene M. Zheganin
Hi. On 12.01.2015 16:41, Eugene M. Zheganin wrote: I'm now also having a strong impression that squid is leaking memory. Now, when 3.4.x is able to handle hundreds of users during several hours I notice that it's memory usage is constantly increasing. My patience always ends at the point of

Re: [squid-users] Memory Leak Squid 3.4.9 on FreeBSD 10.0 x64

2015-01-08 Thread Amos Jeffries
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 9/01/2015 8:10 a.m., Doug Sampson wrote: Hi, I have the similar problem on FreeBSD 10.1-STABLE #1 r275861 with squid-3.4.10. I also applied MEMPOOLS=1 when starting squid. I experience the process slowing down and unacceptable performance.

Re: [squid-users] Memory Leak Squid 3.4.9 on FreeBSD 10.0 x64

2015-01-08 Thread Ludovit Koren
Doug Sampson do...@dawnsign.com writes: Hi, I have the similar problem on FreeBSD 10.1-STABLE #1 r275861 with squid-3.4.10. I also applied MEMPOOLS=1 when starting squid. I experience the process slowing down and unacceptable performance. Squid is configured

Re: [squid-users] Memory Leak Squid 3.4.9 on FreeBSD 10.0 x64

2015-01-08 Thread Doug Sampson
Hi, I have the similar problem on FreeBSD 10.1-STABLE #1 r275861 with squid-3.4.10. I also applied MEMPOOLS=1 when starting squid. I experience the process slowing down and unacceptable performance. Squid is configured to use kerberos and ntlm authentication and lap group authentication.

Re: [squid-users] Memory Leak Squid 3.4.9 on FreeBSD 10.0 x64

2015-01-08 Thread Yuri Voinov
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I mean, cache_mem is too big. First, 600 users is not very big installation to do huge memory cache. 1-2 Gb will be ehough. With fast disk cache. Second - 4 Gb ram is near 32-bit address limit. Possible 32-bit library or somewhat meets this

Re: [squid-users] Memory Leak Squid 3.4.9 on FreeBSD 10.0 x64

2014-12-05 Thread Doug Sampson
On 26/11/2014 8:59 a.m., Doug Sampson wrote: Thanks, Amos, for your pointers. I've commented out all the fresh_patterns lines appearing above the last two lines. I also have dropped diskd in favor of using aufs exclusively, taking out the min-size parameter. I've commented out the

Re: [squid-users] Memory Leak Squid 3.4.9 on FreeBSD 10.0 x64

2014-12-01 Thread k simon
Maybe your problem is related to sysctl mib tuning about swap/overcommit etc. I did not observed memory leak with squid 3.4.4, but FB 10 do swap frequently than old version. Simon ___ squid-users mailing list squid-users@lists.squid-cache.org

Re: [squid-users] Memory Leak Squid 3.4.9 on FreeBSD 10.0 x64

2014-12-01 Thread k simon
I used the ugly tuning: set vm.defer_swapspace_pageouts to 1. But it is may caused some issue when the physic memory is really exhausted. I have no much time to investigate the right way, but I think maybe vm.swap_idle_threshold1/vm.swap_idle_threshold2 or vm.overcommit etc. maybe harmful.

Re: [squid-users] Memory Leak Squid 3.4.9 on FreeBSD 10.0 x64

2014-11-30 Thread Doug Sampson
On 25/11/2014 9:06 a.m., Doug Sampson wrote: Recently due to squid 2.7 being EOL'ed, we migrated our squid server to version 3.4.9 on a FreeBSD 10.0-RELEASE running on 64-bit hardware. We started seeing paging file being swapped out eventually running out of available memory. From the

[squid-users] Memory Leak Squid 3.4.9 on FreeBSD 10.0 x64

2014-11-24 Thread Doug Sampson
Recently due to squid 2.7 being EOL'ed, we migrated our squid server to version 3.4.9 on a FreeBSD 10.0-RELEASE running on 64-bit hardware. We started seeing paging file being swapped out eventually running out of available memory. From the time squid gets started it usually takes about two

Re: [squid-users] Memory Leak Squid 3.4.9 on FreeBSD 10.0 x64

2014-11-24 Thread Amos Jeffries
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 25/11/2014 9:06 a.m., Doug Sampson wrote: Recently due to squid 2.7 being EOL'ed, we migrated our squid server to version 3.4.9 on a FreeBSD 10.0-RELEASE running on 64-bit hardware. We started seeing paging file being swapped out eventually

Re: [squid-users] Memory Leaks after OS upgrade

2014-08-09 Thread Amos Jeffries
On 9/08/2014 6:28 a.m., Nils Hügelmann (anonymoX.net) wrote: Hi, after upgrading to opensuse 13.1, squid3.4 (same with current 3.HEAD) leaks memory after a short time and stops responding to snmp queries(not sure if that's related). From what version? If it was 3.1 or older they have

[squid-users] Memory Leaks after OS upgrade

2014-08-08 Thread Nils Hügelmann (anonymoX.net)
Hi, after upgrading to opensuse 13.1, squid3.4 (same with current 3.HEAD) leaks memory after a short time and stops responding to snmp queries(not sure if that's related). In a test setup i can reproduce the issue as follows: Test with 100 rps: Everything good Test with 250 rps: After some

[squid-users] Memory leak with reconfigure

2014-06-26 Thread Alexandre
* Various memory leaks

Re: [squid-users] Memory leak with reconfigure

2014-06-26 Thread Amos Jeffries
On 27/06/2014 7:20 a.m., Alexandre wrote: * Various memory leaks ?? are you enjoying 3.4.6 or something? Amos

[squid-users] Memory leaks in squid 3.3.5?

2013-07-11 Thread Alex Crow
Hi all, I've been running 3.3.5 with NTLM auth an icap service (c-icap with clamav) and SSL Bump/Dynamic cert, and I've noticed that the squid3 process rapidly consumes almost all of my RAM (12G) within just a few hours: 16143 proxy 20 0 8554m 8.2g 5788 S0 69.6 35:09.43 squid3 My

Re: [squid-users] Memory leaks in squid 3.3.5?

2013-07-11 Thread Eliezer Croitoru
Squid 3.3.7 is out and there was a new leak that was fixed and might caused the problem you are referring to. If you have used my RPM there is an update to 3.3.6 which not includes the latest patches and a 3.3.7 with all the patches will probably be out next week since it builds fine. What

Re: [squid-users] Memory leaks in squid 3.3.5?

2013-07-11 Thread Alex Crow
Hi Eliezer, I build .debs for squeeze, basically copying the debian subdir from the source packages into the extracted archives and adjusting accordingly (ie modifying Changelog and deleteting old patches) I tried wheezy but the OpenSSL 1.0.1 horribly breaks *loads* of sites when using

Re: [squid-users] Memory leaks in squid 3.3.5?

2013-07-11 Thread Eliezer Croitoru
Hey Alex, I am unsure about the reason of breakage of these sites since I have never used squid SSL-BUMP else then compiling it yet. Claiming it's a specific version of OpenSSL is quite a claim. If you have tried with another version I would say you can claim it. I would say that breaking any

Re: [squid-users] Memory leaks in squid 3.3.5?

2013-07-11 Thread Alex Crow
Hi Eliezer, I can tell you that we have come across specific sites that were OK being bumped in squeeze (which comes with OpenSSL 0.9.8) did not work in wheezy, which uses 1.0.1. Here are the example sites we found so far (in the form of acls): acl nobump dstdomain

[squid-users] Memory error with squid 3.3.4 and kerberos authentication

2013-05-03 Thread Carlos Defoe
Hello, I'm seeing a lot of memory errors like this at my squid 3.3.4, using kerberos authentication and ext_kerberos_ldap_group_acl for group mapping. Any known issue? *** glibc detected *** (ext_kerberos_ldap_group_acl): double free or corruption (out): 0x013f0590 *** ===

[squid-users] memory leakage in squid 3.1, 3.2, 3.3.

2013-03-19 Thread Oleg
Hi, all. I have strange problem of memory leakage in squid 3.1, 3.2 and 3.3. Squid is grow fast and is killed by oom every day and use before a killing about 600MB of memory. Interesting thing is that squid 3.2 doesn't fail fully. Fails only it child process and parent process restart it again.

[squid-users] Memory leak in 3.2.5

2012-12-20 Thread Mike Mitchell
I just upgraded from 2.7STABLE9 to 3.2.5, and now I'm battling a memory leak. Squid Cache: Version 3.2.5 configure options: '--prefix=/local/proxy/squid' '--with-maxfd=8192' '--with-pthreads' '--enable-storeio=aufs' '--enable-removal-policies=heap' '--enable-cache-digests'

[squid-users] memory utilization

2011-11-20 Thread benjamin fernandis
Hi All, I configured squid box to get good cache performance and for that i set cache_mem and object size in cache. cat /etc/squid/squid.conf | grep cache_mem cache_mem 6144 MB cat /etc/squid/squid.conf | grep -i maximum_object_size_in_memory maximum_object_size_in_memory 1 MB And whenever i

Re: [squid-users] memory utilization

2011-11-20 Thread Amos Jeffries
On 21/11/2011 1:33 a.m., benjamin fernandis wrote: Hi All, I configured squid box to get good cache performance and for that i set cache_mem and object size in cache. cat /etc/squid/squid.conf | grep cache_mem cache_mem 6144 MB cat /etc/squid/squid.conf | grep -i maximum_object_size_in_memory

Re: [squid-users] memory utilization

2011-11-20 Thread Benjamin
Hi Amos, Really your support is grateful to us.You always help us to understanding of squid and its work pattern.Thanks for your kind support. On 21/11/2011 1:33 a.m., benjamin fernandis wrote: Hi All, I configured squid box to get good cache performance and for that i set cache_mem and

Re: [squid-users] memory utilization

2011-11-20 Thread Amos Jeffries
On 21/11/2011 6:06 p.m., Benjamin wrote: Hi Amos, Really your support is grateful to us.You always help us to understanding of squid and its work pattern.Thanks for your kind support. On 21/11/2011 1:33 a.m., benjamin fernandis wrote: Hi All, I configured squid box to get good cache

[squid-users] Memory leak Squid Cache: Version 3.1.16 + FreeBSD 7.4-STABLE

2011-11-01 Thread budsz
Hallo, After port cvsup, updating lib, packages and so on. I got something weird problem, I guess this cause memory leak. root:~# free SYSTEM MEMORY SUMMARY: mem_used: 574558208 (547MB) [ 53%] Logically used memory mem_avail: +499183616 (476MB) [ 46%] Logically available

Re: [squid-users] Memory leak Squid Cache: Version 3.1.16 + FreeBSD 7.4-STABLE

2011-11-01 Thread Amos Jeffries
On Tue, 1 Nov 2011 16:42:13 +0700, budsz wrote: Hallo, After port cvsup, updating lib, packages and so on. I got something weird problem, I guess this cause memory leak. root:~# free SYSTEM MEMORY SUMMARY: mem_used: 574558208 (547MB) [ 53%] Logically used memory mem_avail: +

[squid-users] Memory Problems

2011-10-13 Thread Michael_Grasso
I'm running Squid 3.1.15 on a server with 24GB of RAM. The OS is SUSE Linix 11 SP1 64bit. If I change the cache_mem higher then 512, I get the below results. If I leave it at 512, everything is normal. I tried 1024 MB and up to 4096 MB with the same results below. Any ideas? Memory usage for

Re: [squid-users] Memory Problems

2011-10-13 Thread Kinkie
On Thu, Oct 13, 2011 at 6:24 PM, michael_gra...@cadc.uscourts.gov wrote: I'm running Squid 3.1.15 on a server with 24GB of RAM. The OS is SUSE Linix 11 SP1 64bit. If I change the cache_mem higher then 512, I get the below results. If I leave it at 512, everything is normal. I tried 1024 MB

Re: [squid-users] Memory Problems

2011-10-13 Thread Michael_Grasso
Subject:Re: [squid-users] Memory Problems On Thu, Oct 13, 2011 at 6:24 PM, michael_gra...@cadc.uscourts.gov wrote: I'm

Re: [squid-users] Memory issues

2011-07-04 Thread Amos Jeffries
On 28/06/11 23:00, Go Wow wrote: I forgot to mention the other day, I searched for latest versions rpm and couldn't find it. Do you know of any location which provides rpms for centos 5.4. I'm afraid not. I have been unable to track down any packaging maintainer for CentOS. They have 2.6

Re: [squid-users] Memory issues

2011-06-28 Thread Go Wow
That's good to hear. ps aux | wc -l shows me 165 ps aux | grep squid |wc -l shows me 46 ps aux | grep httpd |wc -l shows me 10 ps aux | grep perl |wc -l shows me 7 What are these rest 100 processes used for, below is the extract of my ps aux command. http://pastebin.com/0ZVDAL0S Thanks for

Re: [squid-users] Memory issues

2011-06-28 Thread Amos Jeffries
On 28/06/11 19:12, Go Wow wrote: That's good to hear. ps aux | wc -l shows me 165 ps aux | grep squid |wc -l shows me 46 ps aux | grep httpd |wc -l shows me 10 ps aux | grep perl |wc -l shows me 7 What are these rest 100 processes used for, below is the extract of my ps aux command.

Re: [squid-users] Memory issues

2011-06-28 Thread Go Wow
Good Lord!!! The amount of free RAM in my system keeps decreasing, What happens when it RAM reaches to zero? Is it that it remove old object and free up space? On 28 June 2011 11:45, Amos Jeffries squ...@treenet.co.nz wrote: On 28/06/11 19:12, Go Wow wrote: That's good to hear. ps aux | wc

RE: [squid-users] Memory issues

2011-06-28 Thread Jenny Lee
Good Lord!!! The amount of free RAM in my system keeps decreasing, What happens when it RAM reaches to zero? Is it that it remove old object and free up space? It is probably being used by buffer and cache. free -m enter should show you how much available memory and cache there is.

Re: [squid-users] Memory issues

2011-06-28 Thread Go Wow
free -m total used free sharedbuffers cached Mem: 3722 3011710 0305 1352 -/+ buffers/cache: 1353 2369 Swap: 2047 21 2025 Do I genuinely require to increase the memory of

RE: [squid-users] Memory issues

2011-06-28 Thread Jenny Lee
Subject: Re: [squid-users] Memory issues free -m total used free shared buffers cached Mem: 3722 3011 710 0 305 1352 -/+ buffers/cache: 1353 2369 Swap: 2047 21 2025 Do I genuinely require to increase the memory of this system? No. It looks good. I don't understand where you came up

Re: [squid-users] Memory issues

2011-06-28 Thread Go Wow
2011 14:14, Jenny Lee bodycar...@live.com wrote:  Subject: Re: [squid-users] Memory issues free -m total used free shared buffers cached Mem: 3722 3011 710 0 305 1352 -/+ buffers/cache: 1353 2369 Swap: 2047 21 2025 Do I genuinely require to increase the memory of this system? No. It looks

Re: [squid-users] Memory issues

2011-06-28 Thread Amos Jeffries
On 28/06/11 22:31, Go Wow wrote: Look at these graphs which shows swap being used. Memory usage -- http://img.myph.us/Cr8.jpg CPU usage -- http://img.myph.us/PgM.jpg The squid box is serving only 12 users now, the plan is to implement this for 150 users and maybe more in future. I dont want

Re: [squid-users] Memory issues

2011-06-28 Thread Go Wow
I forgot to mention the other day, I searched for latest versions rpm and couldn't find it. Do you know of any location which provides rpms for centos 5.4. On 28 June 2011 14:42, Amos Jeffries squ...@treenet.co.nz wrote: On 28/06/11 22:31, Go Wow wrote: Look at these graphs which shows swap

Re: [squid-users] Memory issues

2011-06-27 Thread Go Wow
Pls find below the link to excel file containing memory info from squid cache manager. https://www.yousendit.com/download/MFo3c0w5bTh0TW14dnc9PQ Now my squid.conf looks like this, is this okay? auth_param negotiate program /usr/lib/squid/squid_kerb_auth -d -s GSS_C_NO_NAME auth_param negotiate

Re: [squid-users] Memory issues

2011-06-27 Thread Go Wow
Any info for me regarding my last post? On 27 June 2011 13:02, Go Wow gow...@gmail.com wrote: Pls find below the link to excel file containing memory info from squid cache manager. https://www.yousendit.com/download/MFo3c0w5bTh0TW14dnc9PQ Now my squid.conf looks like this, is this okay?

Re: [squid-users] Memory issues

2011-06-27 Thread Amos Jeffries
On 27/06/11 21:02, Go Wow wrote: Pls find below the link to excel file containing memory info from squid cache manager. https://www.yousendit.com/download/MFo3c0w5bTh0TW14dnc9PQ Shows Squid using 4MB of RAM. Now my squid.conf looks like this, is this okay? Looks fine now. snip Are

[squid-users] Memory issues

2011-06-26 Thread Go Wow
Hi, I'm using squid 3.1.8 on centos 5.4 with 3.8GB RAM and Dual Core Processor. My swap is been used and 50% of RAM is used by cache buffers. Below link has one week's memory CPU utilization information in form of graph. Memory usage -- http://img.myph.us/Cr8.jpg CPU usage --

Re: [squid-users] Memory issues

2011-06-26 Thread Amos Jeffries
On 26/06/11 21:24, Go Wow wrote: Hi, I'm using squid 3.1.8 on centos 5.4 with 3.8GB RAM and Dual Core Processor. My swap is been used and 50% of RAM is used by cache buffers. Below link has one week's memory CPU utilization information in form of graph. Memory usage --

[squid-users] memory only cache system

2011-04-26 Thread Jeff Pang
I have not used squid for quite a few months, so many stuff has lost from my memory, :) How can I config squid with memory only cache system? I have 16G memory but the content size is only 4G. Thanks.

Re: [squid-users] memory only cache system

2011-04-26 Thread Amos Jeffries
On Wed, 27 Apr 2011 11:12:17 +0800, Jeff Pang wrote: I have not used squid for quite a few months, so many stuff has lost from my memory, :) How can I config squid with memory only cache system? I have 16G memory but the content size is only 4G. Thanks. - erase all existing cache_dir entries

[squid-users] Memory leaks in squid 2.7.STABLE7, reverse proxy for OWA 2007

2010-10-18 Thread Roberto Suarez Soto
Hi, (sending again because ezlm didn't like my attaches before) we've got squid 2.7.STABLE7, running on Ubuntu 10.04, as reverse proxy for OWA 2007 (or Exchange 2007; excuse me if there are differences, I don't know much about Windows products). It has been recompiled with

Re: [squid-users] Antwort: Re: [squid-users] Memory and CPU usage squid-3.1.4

2010-07-05 Thread Marcus Kool
The memory leak is caused by idnsGrokReply: the caller of rfc1035MessageUnpack should free the memory using rfc1035MessageDestroy. The function idnsGrokReply has several changes between 3.0.x and 3.1.x. It is obvious that not all paths call rfc1035MessageDestroy but I do not know this code and

Re: Re: [squid-users] Antwort: Re: [squid-users] Memory and CPU usage squid-3.1.4

2010-07-01 Thread Martin . Pichlmaier
Hello list, I just wanted to post the results with valgrind. Unfortunately the memcheck thread needs so much CPU that I could not put a high load on the squid as maximum only about 5-10 req/s. # ./squid -v Squid Cache: Version 3.1.3 configure options: '--prefix=/appl' '--localstate=/var'

[squid-users] Antwort: Re: [squid-users] Antwort: Re: [squid-users] Memory and CPU usage squid-3.1.4

2010-06-18 Thread Martin . Pichlmaier
Thank you for your info, I will give it a try. Martin Marcus Kool marcus.k...@urlfilterdb.com wrote on 17.06.2010 16:15:09: Martin, Valgrind is a memory leak detection tool. You need some developer skills to run it. If you have a test environment with low load you may want to give it a

Re: Re: [squid-users] Antwort: Re: [squid-users] Memory and CPU usage squid-3.1.4

2010-06-17 Thread Martin . Pichlmaier
Hello, I just wanted to report back the last tests: After the memory cache is filled to 100% the squid (3.1.4 or 3.1.3) still needs more memory over time when under load, about 1-2 GB a day. memory_pool off did not change anything, the process size still rises. The high CPU usage seem to start

Re: [squid-users] Antwort: Re: [squid-users] Memory and CPU usage squid-3.1.4

2010-06-17 Thread Marcus Kool
Martin, Valgrind is a memory leak detection tool. You need some developer skills to run it. If you have a test environment with low load you may want to give it a try. - download the squid sources - run configure with CFLAGS=-g -O2 - run squid with valgrind - wait - kill squid with a TERM

[squid-users] Memory and CPU usage squid-3.1.4

2010-06-15 Thread Martin . Pichlmaier
Hello list, I have a question regarding memory and CPU usage change from 3.0 to 3.1. I have 4 forwards proxies with ICAP (c-icap and clamav), NTLMv2 authentication, all four proxies each have about 200-400 req/sec on RedHat AS5 64bit servers with each 16GB mem for about 15k to 30k users.

Re: [squid-users] Memory and CPU usage squid-3.1.4

2010-06-15 Thread Amos Jeffries
martin.pichlma...@continental-corporation.com wrote: Hello list, I have a question regarding memory and CPU usage change from 3.0 to 3.1. I have 4 forwards proxies with ICAP (c-icap and clamav), NTLMv2 authentication, all four proxies each have about 200-400 req/sec on RedHat AS5 64bit

[squid-users] Antwort: Re: [squid-users] Memory and CPU usage squid-3.1.4

2010-06-15 Thread Martin . Pichlmaier
Amos Jeffries squ...@treenet.co.nz wrote on 15.06.2010 10:48:33: martin.pichlma...@continental-corporation.com wrote: Hello list, I have a question regarding memory and CPU usage change from 3.0 to 3.1. I have 4 forwards proxies with ICAP (c-icap and clamav), NTLMv2

Re: [squid-users] Antwort: Re: [squid-users] Memory and CPU usage squid-3.1.4

2010-06-15 Thread Amos Jeffries
martin.pichlma...@continental-corporation.com wrote: Amos Jeffries squ...@treenet.co.nz wrote on 15.06.2010 10:48:33: martin.pichlma...@continental-corporation.com wrote: Hello list, I have a question regarding memory and CPU usage change from 3.0 to 3.1. I have 4 forwards proxies with

[squid-users] Memory Considerations when you are running multiple instances of squid on the same server.

2010-05-21 Thread GIGO .
Hi All, can it be said as a generalization that one can allocate/fix 1/4 of physical ram for cache mem objects. Will it holds true even when you are running multiple instances??? please guide that how memory handling will be occuring in multiple instances setup???cache_mem will

Re: [squid-users] Memory Considerations when you are running multiple instances of squid on the same server.

2010-05-21 Thread Henrik Nordström
fre 2010-05-21 klockan 06:38 + skrev GIGO .: can it be said as a generalization that one can allocate/fix 1/4 of physical ram for cache mem objects. Will it holds true even when you are running multiple instances??? I would not generalize a rule like that. It is a reasonable

RE: [squid-users] Memory Considerations when you are running multiple instances of squid on the same server.

2010-05-21 Thread GIGO .
Thank you for explaining well regards, Bilal From: hen...@henriknordstrom.net To: gi...@msn.com CC: squid-users@squid-cache.org Date: Fri, 21 May 2010 09:53:06 +0200 Subject: Re: [squid-users] Memory Considerations when you are running multiple

Re: [squid-users] Memory usage for squid via mallinfo Total in use: 100%

2010-04-01 Thread Henrik Nordström
ons 2010-03-31 klockan 16:04 -0500 skrev Kevin Blackwell: Should i be concerned about Total in use: 3539 KB 96%? No. The % is % of the total memory the Squid process has reserved from the OS, not the maximum possible. Contrary to intuition the situation where one should worry about this % is

[squid-users] Memory usage for squid via mallinfo Total in use: 100%

2010-03-31 Thread Kevin Blackwell
1st, I'm not sure this is good, and this is right after a restart Memory usage for squid via mallinfo(): Total space in arena:3180 KB Ordinary blocks: 3035 KB 2 blks Small blocks: 0 KB 0 blks Holding blocks: 504 KB 2 blks

Re: [squid-users] Memory usage...

2010-03-05 Thread John Doe
From: Amos Jeffries squ...@treenet.co.nz Actual experienced measurements from some general-purpose web caches. On 32-bit systems. Newer 64-bit systems have reported a 15MB/GB requirement. It's the amount of data seen to be used for index meta data and other types of index. ... The

Re: [squid-users] Memory usage...

2010-03-05 Thread Amos Jeffries
John Doe wrote: From: Amos Jeffries squ...@treenet.co.nz Actual experienced measurements from some general-purpose web caches. On 32-bit systems. Newer 64-bit systems have reported a 15MB/GB requirement. It's the amount of data seen to be used for index meta data and other types of index. ...

Re: [squid-users] Antwort: Re: [squid-users] memory usage for squid-3.0.STABLE15

2009-07-01 Thread Matus UHLAR - fantomas
On 30.06.09 13:13, martin.pichlma...@continental-corporation.com wrote: I checked -- cached objects are not re-checked, at least not with two or three hours. But the memory usage is higher still without icap while the cache is still filling -- but this may due to the fact that I configured

[squid-users] Antwort: Re: [squid-users] memory usage for squid-3.0.STABLE15

2009-06-30 Thread Martin . Pichlmaier
I checked -- cached objects are not re-checked, at least not with two or three hours. But the memory usage is higher still without icap while the cache is still filling -- but this may due to the fact that I configured squid to cache objects only up to 1 MB and icap scans larger objects, too.

Re: [squid-users] memory usage for squid-3.0.STABLE15

2009-06-29 Thread Matus UHLAR - fantomas
On 25.06.09 15:39, martin.pichlma...@continental-corporation.com wrote: I have a question regarding memory usage for squid. I have 4 proxies, each has about 200-400 req/s and 2-5 MB/s with ntlm_auth and about 1000 lines of acl, squid version is 3.0.STABLE15 on Redhat AS 5 Linux. They are

[squid-users] memory usage for squid-3.0.STABLE15

2009-06-25 Thread Martin . Pichlmaier
Hi Everybody, I have a question regarding memory usage for squid. I have 4 proxies, each has about 200-400 req/s and 2-5 MB/s with ntlm_auth and about 1000 lines of acl, squid version is 3.0.STABLE15 on Redhat AS 5 Linux. They are busy servers and therefore have no disk cache but memory cache

Re: [squid-users] Memory leak?

2009-04-23 Thread Bin Liu
The squid process grows without bounds here. I've read the FAQ, and tried lowering cache_mem setting, decreasing cache_dir size. That server has 4GB physical memory, and with total cache_dir size setting to 60G, squid resident size still can grow beyond bound and start eating swap. Note

Re: [squid-users] Memory leak?

2009-04-21 Thread Amos Jeffries
Bin Liu wrote: Thanks for your reply. # /usr/local/squid/sbin/squid -v Squid Cache: Version 2.7.STABLE6 configure options: '--prefix=/usr/local/squid' '--with-pthreads' '--with-aio' '--with-dl' '--with-large-files' '--enable-storeio=ufs,aufs,diskd,coss,null'

[squid-users] Memory leak?

2009-04-20 Thread Bin Liu
I've already set memory_pools off in squid.conf, so squid should free all unused memory. But I can still see these lines in cachemgr after running for some time: memPoolAlloc calls: 549769495 memPoolFree calls: 545292412 Did I miss something? Regards

Re: [squid-users] Memory leak?

2009-04-20 Thread Amos Jeffries
Bin Liu wrote: I've already set memory_pools off in squid.conf, so squid should free all unused memory. But I can still see these lines in cachemgr after running for some time: memPoolAlloc calls: 549769495 memPoolFree calls: 545292412 Did I miss something? Usually this turns out to be

Re: [squid-users] Memory leak?

2009-04-20 Thread Bin Liu
Thanks for your reply. # /usr/local/squid/sbin/squid -v Squid Cache: Version 2.7.STABLE6 configure options: '--prefix=/usr/local/squid' '--with-pthreads' '--with-aio' '--with-dl' '--with-large-files' '--enable-storeio=ufs,aufs,diskd,coss,null' '--enable-removal-policies=lru,heap' '--enable-htcp'

Re: [squid-users] ...Memory-only Squid questions

2009-04-07 Thread Amos Jeffries
Gregori Parker wrote: Glad to help David, please let us know how it progresses. Dont know if you saw this in the archives: http://www.mail-archive.com/squid-users@squid-cache.org/msg19824.html but it might help guide you on your SO_FAIL issue. It might be worth moving to LRU and establishing

Re: [squid-users] ...Memory-only Squid questions

2009-04-07 Thread Chris Robertson
David Tosoff wrote: Thanks Chris. I had already read both of the wiki post and the thread you directed me to before I posted this to the group. Excellent. I already had compiled heap into my squid before this issue happened. I am using heap GDSF. And, I wasn't able to find

Re: [squid-users] ...Memory-only Squid questions

2009-04-07 Thread Amos Jeffries
David Tosoff wrote: Thanks Chris. I had already read both of the wiki post and the thread you directed me to before I posted this to the group. Excellent. I already had compiled heap into my squid before this issue happened. I am using heap GDSF. And, I wasn't able to find

[squid-users] ...Memory-only Squid questions

2009-04-06 Thread David Tosoff
what I want to be using here? The SO_FAIL's concern me, but I'm not sure if they should? Thanks! David --- On Sat, 4/4/09, David Tosoff dtos...@yahoo.com wrote: From: David Tosoff dtos...@yahoo.com Subject: [squid-users] Memory-only Squid questions To: squid-users@squid-cache.org Received

Re: [squid-users] ...Memory-only Squid questions

2009-04-06 Thread Chris Robertson
David Tosoff wrote: Hey all, haven't heard anything on this and could really use some help. :) You can disregard the HIT related questions, as once I placed this into a full scale test, it started hitting from memory wonderfully (~40% offload from the origin) Good news... The config

Re: [squid-users] ...Memory-only Squid questions

2009-04-06 Thread David Tosoff
crobert...@gci.net wrote: From: Chris Robertson crobert...@gci.net Subject: Re: [squid-users] ...Memory-only Squid questions To: squid-users@squid-cache.org Received: Monday, April 6, 2009, 4:56 PM David Tosoff wrote: Hey all, haven't heard anything on this and could really use some help

RE: [squid-users] ...Memory-only Squid questions

2009-04-06 Thread Gregori Parker
[mailto:dtos...@yahoo.com] Sent: Mon 4/6/2009 8:46 PM To: squid-users@squid-cache.org; Chris Robertson Subject: Re: [squid-users] ...Memory-only Squid questions Thanks Chris. I had already read both of the wiki post and the thread you directed me to before I posted this to the group. I already had

  1   2   3   >