Re: [squid-users] 2003/08/13 08:20:21| httpAccept: FD 15: accept failure: (24) Too many open files
On Monday 18 August 2003 20.50, Brian Hechinger wrote: > On Mon, Aug 18, 2003 at 08:47:14PM +0200, Henrik Nordstrom wrote: > > > [EMAIL PROTECTED] sudo pfiles 6681 > > > 6681: (squid) -D > > > Current rlimit: 512 file descriptors > > > > Seem to me you did not set the hard ulimit before you started > > Squid. > > i set the hard limit before i start squid. i set the hard limit > when i built squid. what could i *possibly* be missing? You need to set the soft limit before building Squid (which you seem to have done as configure found the new limit) and then the hard limit before you start Squid. Squid automatically sets the soft limit equal to the hard limit on startup in order to gain the highest allowed limit. However, root is allowed to artificially raise his soft limit above his hard limit which is counter-productive when using Squid. Regards Henrik
Re: [squid-users] 2003/08/13 08:20:21| httpAccept: FD 15: accept failure: (24) Too many open files
On Mon, Aug 18, 2003 at 08:47:14PM +0200, Henrik Nordstrom wrote: > > > [EMAIL PROTECTED] sudo pfiles 6681 > > 6681: (squid) -D > > Current rlimit: 512 file descriptors > > Seem to me you did not set the hard ulimit before you started Squid. problem solved. there was a 'ulimit -n 512' in the startup script i was calling. i wonder why i put that in there? -brian -- "You know, evil comes in many forms, be it a man-eating cow or Joseph Stalin. But you can't let the package hide the pudding. Evil is just plain bad! You don't cotton to it! You gotta smack it on the nose with the rolled up newspaper of goodness! Bad dog! Bad dog!" -- The Tick
Re: [squid-users] 2003/08/13 08:20:21| httpAccept: FD 15: accept failure: (24) Too many open files
On Mon, Aug 18, 2003 at 08:47:14PM +0200, Henrik Nordstrom wrote: > > > [EMAIL PROTECTED] sudo pfiles 6681 > > 6681: (squid) -D > > Current rlimit: 512 file descriptors > > Seem to me you did not set the hard ulimit before you started Squid. i set the hard limit before i start squid. i set the hard limit when i built squid. what could i *possibly* be missing? -brian -- "You know, evil comes in many forms, be it a man-eating cow or Joseph Stalin. But you can't let the package hide the pudding. Evil is just plain bad! You don't cotton to it! You gotta smack it on the nose with the rolled up newspaper of goodness! Bad dog! Bad dog!" -- The Tick
Re: [squid-users] 2003/08/13 08:20:21| httpAccept: FD 15: accept failure: (24) Too many open files
On Monday 18 August 2003 20.28, Brian Hechinger wrote: > which is what i set it to. however, it still seems to be getting > limited to 512 max. > > [EMAIL PROTECTED] sudo pfiles 6681 > 6681: (squid) -D > Current rlimit: 512 file descriptors Seem to me you did not set the hard ulimit before you started Squid. Regards Henrik
Re: [squid-users] 2003/08/13 08:20:21| httpAccept: FD 15: accept failure: (24) Too many open files
On Mon, Aug 18, 2003 at 08:23:26PM +0200, Henrik Nordstrom wrote: > > And what did configure report while you built your Squid? > > (see include/autoconf.h if you do not have the configure output > available). /* Maximum number of open filedescriptors */ #define SQUID_MAXFD 8192 which is what i set it to. however, it still seems to be getting limited to 512 max. [EMAIL PROTECTED] sudo pfiles 6681 6681: (squid) -D Current rlimit: 512 file descriptors -brian -- "You know, evil comes in many forms, be it a man-eating cow or Joseph Stalin. But you can't let the package hide the pudding. Evil is just plain bad! You don't cotton to it! You gotta smack it on the nose with the rolled up newspaper of goodness! Bad dog! Bad dog!" -- The Tick
Re: [squid-users] 2003/08/13 08:20:21| httpAccept: FD 15: accept failure: (24) Too many open files
On Monday 18 August 2003 19.57, Brian Hechinger wrote: > On Thu, Aug 14, 2003 at 10:58:47PM +0200, Henrik Nordstrom wrote: > > 1. You need to set the ulimit to the highest value you want your > > Squid binary to support while you compile your Squid. > > did that. And what did configure report while you built your Squid? (see include/autoconf.h if you do not have the configure output available). Regards Henrik
Re: [squid-users] 2003/08/13 08:20:21| httpAccept: FD 15: accept failure: (24) Too many open files
On Thu, Aug 14, 2003 at 10:58:47PM +0200, Henrik Nordstrom wrote: > > 1. You need to set the ulimit to the highest value you want your Squid > binary to support while you compile your Squid. did that. > 2. Before starting Squid you need to set the hard ulimit to the number you > want this Squid to support. did that. however, i still seem to be getting limited to 512, and i don't understand why. -brian -- "You know, evil comes in many forms, be it a man-eating cow or Joseph Stalin. But you can't let the package hide the pudding. Evil is just plain bad! You don't cotton to it! You gotta smack it on the nose with the rolled up newspaper of goodness! Bad dog! Bad dog!" -- The Tick
Re: [squid-users] 2003/08/13 08:20:21| httpAccept: FD 15: accept failure: (24) Too many open files
Brian Hechinger wrote: > > i get a TON of these. had to restart squid. is this related to my other issue > with Resource temporarily unavailable? is this the solaris ufs thing biting me > in the you know what? > > if it's the UFS issue, i can drop VxFS on there to fix it, if it's the other > thing, it might be time to port the SiteMinder patch to STABLE3 > Check your kernel config; you will need to increase the max. open files limit. M.
Re: [squid-users] 2003/08/13 08:20:21| httpAccept: FD 15: accept failure: (24) Too many open files
On Wednesday 13 August 2003 19.39, Brian Hechinger wrote: > so ulimit for filedescriptors on solaris defaults to 256 for > non-root. is there a way to determine how many filedescriptors > squid needs so that i can set a proper ulimit? A reasonable amount is at least 3 * number of concurrent users. In some configuration (especially if not using half_closed_clients off) more is needed, and the number is also larger for smaller amounts of users (the "unexpected" variance in browsing request load is larger making bigger extremes in relation to the number of users on small numbers of users) Note: The default limit for files on Solaris is usually 1024 with a soft limit of 256, allowing non-root users to change their files ulimit up to 1024. Squid automatically sets the ulimit as high as possible on startup, but you may need to raise it manually while building Squid. Regards Henrik -- Donations welcome if you consider my Free Squid support helpful. https://www.paypal.com/xclick/business=hno%40squid-cache.org If you need commercial Squid support or cost effective Squid or firewall appliances please refer to MARA Systems AB, Sweden http://www.marasystems.com/, [EMAIL PROTECTED]
Re: [squid-users] 2003/08/13 08:20:21| httpAccept: FD 15: accept failure: (24) Too many open files
On Wed, Aug 13, 2003 at 05:03:32PM +0200, Henrik Nordstrom wrote: > > Either Squid ran out of filedescriptors, or your system ran out of > files/sockets reaching the kernel limit on these. ok, i'll up FDs first and see what happens. > It is not the UFS issue. ok, good. -brian -- "You know, evil comes in many forms, be it a man-eating cow or Joseph Stalin. But you can't let the package hide the pudding. Evil is just plain bad! You don't cotton to it! You gotta smack it on the nose with the rolled up newspaper of goodness! Bad dog! Bad dog!" -- The Tick
[squid-users] 2003/08/13 08:20:21| httpAccept: FD 15: accept failure: (24) Too many open files
i get a TON of these. had to restart squid. is this related to my other issue with Resource temporarily unavailable? is this the solaris ufs thing biting me in the you know what? if it's the UFS issue, i can drop VxFS on there to fix it, if it's the other thing, it might be time to port the SiteMinder patch to STABLE3 thanks! -brian -- "You know, evil comes in many forms, be it a man-eating cow or Joseph Stalin. But you can't let the package hide the pudding. Evil is just plain bad! You don't cotton to it! You gotta smack it on the nose with the rolled up newspaper of goodness! Bad dog! Bad dog!" -- The Tick
Re: [squid-users] 2003/08/13 08:20:21| httpAccept: FD 15: accept failure: (24) Too many open files
On Wed, Aug 13, 2003 at 08:23:31PM +0200, Henrik Nordstrom wrote: > > A reasonable amount is at least 3 * number of concurrent users. In ok, so we are only guessing, but there could be anywhere from 1000-2000 concurrent users during peak times. a limit of 6000 FDs would not be unreasonable then? > Note: The default limit for files on Solaris is usually 1024 with a > soft limit of 256, allowing non-root users to change their files > ulimit up to 1024. Squid automatically sets the ulimit as high as > possible on startup, but you may need to raise it manually while > building Squid. before starting squid (su from root) i set nofiles to unlimited, then start squid. however, pfiles shows: [EMAIL PROTECTED] sudo pfiles 6369 | head 6369: (squid) -D Current rlimit: 512 file descriptors this doesn't look like it's doing what i want. how can i set this up so that squid gets the proper number of FDs? thanks!! -brian -- "You know, evil comes in many forms, be it a man-eating cow or Joseph Stalin. But you can't let the package hide the pudding. Evil is just plain bad! You don't cotton to it! You gotta smack it on the nose with the rolled up newspaper of goodness! Bad dog! Bad dog!" -- The Tick
Re: [squid-users] 2003/08/13 08:20:21| httpAccept: FD 15: accept failure: (24) Too many open files
Just increase the number of open files in your OS. (ulimit) rgrds, BArt Quoting Brian Hechinger <[EMAIL PROTECTED]>: > i get a TON of these. had to restart squid. is this related to my other > issue > with Resource temporarily unavailable? is this the solaris ufs thing biting > me > in the you know what? > > if it's the UFS issue, i can drop VxFS on there to fix it, if it's the > other > thing, it might be time to port the SiteMinder patch to STABLE3 > > thanks! > > -brian > -- > "You know, evil comes in many forms, be it a man-eating cow or Joseph > Stalin. > But you can't let the package hide the pudding. Evil is just plain bad! You > don't cotton to it! You gotta smack it on the nose with the rolled up > newspaper > of goodness! Bad dog! Bad dog!" -- The Tick > Schelstraete Bart [EMAIL PROTECTED] - http://www.schelstraete.org http://langmixer.mozdev.org
Re: [squid-users] 2003/08/13 08:20:21| httpAccept: FD 15: accept failure: (24) Too many open files
Brian > so ulimit for filedescriptors on solaris defaults to 256 for > non-root. is there a way to determine how many filedescriptors > squid needs so that i can set a proper ulimit? Cachemgr.cgi's General Runtime page tells you how many you are currently using: File descriptor usage for squid: Maximum number of file descriptors: 2048 Largest file desc currently in use:514 Number of file desc currently in use: 491 Files queued for open: 0 Available number of file descriptors: 1557 Reserved number of file descriptors: 100 Many people who have posted have started with 1024 and then tuned it based on the above stats. I explained what I did to make the changes here: http://groups.google.com/groups?selm=bdpt9q%242ofj%241%40FreeBSD.csie.NCTU.edu.tw Fortunately Henrik corrected a mistake I made when he wrote me: > You should not increase the rlim_fd_cur beyond the default 256 on > Solaris. Doing so may break most 32-bit applications in certain conditions.. I'd missed that in the Solaris FAQ: http://groups.google.com/groups?selm=casper.911853620%40nl-usenet.sun.com (look at # 3.45). hth adam
Re: [squid-users] 2003/08/13 08:20:21| httpAccept: FD 15: accept failure: (24) Too many open files
so ulimit for filedescriptors on solaris defaults to 256 for non-root. is there a way to determine how many filedescriptors squid needs so that i can set a proper ulimit? -brian On Wed, Aug 13, 2003 at 06:06:44AM -0700, Schelstraete Bart wrote: > Just increase the number of open files in your OS. > > (ulimit) > > > rgrds, > > BArt > Quoting Brian Hechinger <[EMAIL PROTECTED]>: > > > i get a TON of these. had to restart squid. is this related to my other > > issue > > with Resource temporarily unavailable? is this the solaris ufs thing biting > > me > > in the you know what? > > > > if it's the UFS issue, i can drop VxFS on there to fix it, if it's the > > other > > thing, it might be time to port the SiteMinder patch to STABLE3 > > > > thanks! > > > > -brian > > -- > > "You know, evil comes in many forms, be it a man-eating cow or Joseph > > Stalin. > > But you can't let the package hide the pudding. Evil is just plain bad! You > > don't cotton to it! You gotta smack it on the nose with the rolled up > > newspaper > > of goodness! Bad dog! Bad dog!" -- The Tick > > > > > Schelstraete Bart > [EMAIL PROTECTED] - http://www.schelstraete.org > http://langmixer.mozdev.org -- "You know, evil comes in many forms, be it a man-eating cow or Joseph Stalin. But you can't let the package hide the pudding. Evil is just plain bad! You don't cotton to it! You gotta smack it on the nose with the rolled up newspaper of goodness! Bad dog! Bad dog!" -- The Tick
