[squid-users] Squid Crashes when cache dir fills

[Wilson Hernandez - MSD, S. A.]

Hello.

I have experienced some sort of crash with squid. I noticed that when 
the cache directory fills up, squid stops caching, it only allows 
communication through with the messenger and users start getting the 
unable to redirect message on the browser.


If I delete the directory and create it again squid -z then everything 
works fine.

RE: [squid-users] Squid Crashes when cache dir fills

[Andrew Loughnan]

Hi Wilson

Check that your cache_dir is not too big ? (cache_dir diskd /var/spool/squid 
2 32 256)

Let us know what you have as your configs for this?
If it runs out of space it will crash all the time 

Regards
Andrew Loughnan
Computer Services Manager
 
St Joseph's College 
135 Aphrasia Street Newtown Vic 3220
E: andr...@sjc.vic.edu.au
P/h: (03) 5226-8165 
M:  0412-523-011
Fax:(03) 5221-6983 

-Original Message-
From: Wilson Hernandez - MSD, S. A. [mailto:w...@msdrd.com] 
Sent: Tuesday, 24 February 2009 10:37 PM
To: squid-users@squid-cache.org
Subject: [squid-users] Squid Crashes when cache dir fills

Hello.

I have experienced some sort of crash with squid. I noticed that when 
the cache directory fills up, squid stops caching, it only allows 
communication through with the messenger and users start getting the 
unable to redirect message on the browser.

If I delete the directory and create it again squid -z then everything 
works fine.

Re: [squid-users] Squid Crashes when cache dir fills

[Wilson Hernandez - MSD, S. A.]

I have cache_dir ufs /var/log/squid 6 255 255

with a 80GB harddrive.

Andrew Loughnan wrote:

Hi Wilson

Check that your cache_dir is not too big ? (cache_dir diskd /var/spool/squid 
2 32 256)

Let us know what you have as your configs for this?
If it runs out of space it will crash all the time 


Regards
Andrew Loughnan
Computer Services Manager
 
St Joseph's College 
135 Aphrasia Street Newtown Vic 3220

E: andr...@sjc.vic.edu.au
P/h: (03) 5226-8165 
M:  0412-523-011
Fax:(03) 5221-6983 


-Original Message-
From: Wilson Hernandez - MSD, S. A. [mailto:w...@msdrd.com] 
Sent: Tuesday, 24 February 2009 10:37 PM

To: squid-users@squid-cache.org
Subject: [squid-users] Squid Crashes when cache dir fills

Hello.

I have experienced some sort of crash with squid. I noticed that when 
the cache directory fills up, squid stops caching, it only allows 
communication through with the messenger and users start getting the 
unable to redirect message on the browser.


If I delete the directory and create it again squid -z then everything 
works fine.





--
*Wilson Hernandez*
Presidente
829.848.9595
809.766.0441
www.msdrd.com <http://www.msdrd.com>
Conservando el medio ambiente

Re: [squid-users] Squid Crashes when cache dir fills

[Amos Jeffries]

Wilson Hernandez - MSD, S. A. wrote:

I have cache_dir ufs /var/log/squid 6 255 255

with a 80GB harddrive.


So its probably not the cache dir filling up then.
It will be something else causing the system to use more than 20 GB for 
other stuff.


Logs or journaling maybe? Are they all rotating regularly?

Amos



Andrew Loughnan wrote:

Hi Wilson

Check that your cache_dir is not too big ? (cache_dir diskd 
/var/spool/squid 2 32 256)


Let us know what you have as your configs for this?
If it runs out of space it will crash all the time
Regards
Andrew Loughnan
Computer Services Manager
 
St Joseph's College 135 Aphrasia Street Newtown Vic 3220

E: andr...@sjc.vic.edu.au
P/h: (03) 5226-8165 M:  0412-523-011
Fax:(03) 5221-6983
-Original Message-
From: Wilson Hernandez - MSD, S. A. [mailto:w...@msdrd.com] Sent: 
Tuesday, 24 February 2009 10:37 PM

To: squid-users@squid-cache.org
Subject: [squid-users] Squid Crashes when cache dir fills

Hello.

I have experienced some sort of crash with squid. I noticed that when 
the cache directory fills up, squid stops caching, it only allows 
communication through with the messenger and users start getting the 
unable to redirect message on the browser.


If I delete the directory and create it again squid -z then everything 
works fine.








--
Please be using
  Current Stable Squid 2.7.STABLE6 or 3.0.STABLE13
  Current Beta Squid 3.1.0.5

Re: [squid-users] Squid Crashes when cache dir fills

[Wilson Hernandez - MSD, S. A.]

Amos Jeffries wrote:

Wilson Hernandez - MSD, S. A. wrote:

I have cache_dir ufs /var/log/squid 6 255 255

with a 80GB harddrive.


So its probably not the cache dir filling up then.
It will be something else causing the system to use more than 20 GB for 
other stuff.


Logs or journaling maybe? Are they all rotating regularly?



I don't think so. But, I'll keep that in mind.

One other thing. As of late, the cache has stopped working without 
giving me any clue of why it did. I reviewed the cache.log file but 
can't figure out why is crashing. Where else can I look for clues of why 
  is crashing?

RE: [squid-users] Squid Crashes when cache dir fills

[joost.deheer]

>I have cache_dir ufs /var/log/squid 6 255 255

>with a 80GB harddrive.

- ufs is an old store system, aufs will probably give you better
performance.
- How is the inode usage on the disk?
- The disksize is irrelevant, the partition size of the partition where
/var/log/squid resides is relevant. If that partition is only 10G, then
this cache won't work.

Joost

Re: [squid-users] Squid Crashes when cache dir fills

[Angela Williams]

Hi!
On Thursday 26 February 2009, Wilson Hernandez - MSD, S. A. wrote:
> Amos Jeffries wrote:
> > Wilson Hernandez - MSD, S. A. wrote:
> >> I have cache_dir ufs /var/log/squid 6 255 255

Your cache_dir line says create a squid cache directory structure 255 wide by 
255 deep and allow it to grow up to 60G. Squid will continue to try and store 
objects into the directory structure until either 60G limit is reached or the 
filesystem - more like as not /var - runs out of space.
If it runs out of space squid is no longer able to write to its log files you 
configured in your squid.conf file. If it cannot write to the log file it 
cannot tell you want happened!

Do you want a nice simple solution?
Add a second hard drive and have squid create its 60G sized cache there.
Make certain logrotate is rotating the normal system logs  and asking squid to 
rotate its logs!

Use df and see just how fuch free space is really available in /var if it is a 
filesystem in its own right.

Another thought?
How many users are trying to access the 'net via this proxy that you want to 
store 60G in a 256 by 256 structure? Last time I looked through the docs and 
faq's there was a good write up on sizing the cache - both hard and soft.

Cheers
Ang
-- 
Angela Williams Enterprise Outsourcing
Unix/Linux & Cisco spoken here! Bedfordview
an...@eoh.co.za Gauteng South Africa
+27116078155Blog: angierfw.wordpress.com

Smile!! Jesus Loves You!!

Re: [squid-users] Squid Crashes when cache dir fills

[Wilson Hernandez - MSD, S. A.]

The store system is actually aufs and the partition is 77GB. I don't 
have anything else other than iptables and squid installed on this system.


joost.deh...@getronics.com wrote:

I have cache_dir ufs /var/log/squid 6 255 255



with a 80GB harddrive.


- ufs is an old store system, aufs will probably give you better
performance.
- How is the inode usage on the disk?
- The disksize is irrelevant, the partition size of the partition where
/var/log/squid resides is relevant. If that partition is only 10G, then
this cache won't work.

Joost




--
*Wilson Hernandez*
Presidente
829.848.9595
809.766.0441
www.msdrd.com 
Conservando el medio ambiente

Re: [squid-users] Squid Crashes when cache dir fills

[Wilson Hernandez - MSD, S. A.]

I have approximately 75 users on my lan that continually use that 
server. I will consider your solutions and implement them and test how 
squid behaves.


So, what is the recommended cache size for a squid system running with 
over 75 users?


Thanks.

Angela Williams wrote:

Hi!
On Thursday 26 February 2009, Wilson Hernandez - MSD, S. A. wrote:

Amos Jeffries wrote:

Wilson Hernandez - MSD, S. A. wrote:

I have cache_dir ufs /var/log/squid 6 255 255


Your cache_dir line says create a squid cache directory structure 255 wide by 
255 deep and allow it to grow up to 60G. Squid will continue to try and store 
objects into the directory structure until either 60G limit is reached or the 
filesystem - more like as not /var - runs out of space.
If it runs out of space squid is no longer able to write to its log files you 
configured in your squid.conf file. If it cannot write to the log file it 
cannot tell you want happened!


Do you want a nice simple solution?
Add a second hard drive and have squid create its 60G sized cache there.
Make certain logrotate is rotating the normal system logs  and asking squid to 
rotate its logs!


Use df and see just how fuch free space is really available in /var if it is a 
filesystem in its own right.


Another thought?
How many users are trying to access the 'net via this proxy that you want to 
store 60G in a 256 by 256 structure? Last time I looked through the docs and 
faq's there was a good write up on sizing the cache - both hard and soft.


Cheers
Ang


--
*Wilson Hernandez*
Presidente
829.848.9595
809.766.0441
www.msdrd.com 
Conservando el medio ambiente