Hello, A squid box we recently upgraded to use Websense 7.1 has intermitent issues. See the log below.. <SNIP>
Dec 28 10:03:00 dss-so92la05 squid[26940]: Starting Squid Cache version 2.7.STABLE6 for i686-pc-linux-gnu... Dec 28 10:03:00 dss-so92la05 squid[26940]: Process ID 26940 Dec 28 10:03:00 dss-so92la05 squid[26940]: With 4096 file descriptors available Dec 28 10:03:00 dss-so92la05 squid[26940]: Using epoll for the IO loop Dec 28 10:03:00 dss-so92la05 squid[26940]: DNS Socket created at 0.0.0.0, port 33381, FD 6 Dec 28 10:03:00 dss-so92la05 squid[26940]: Adding nameserver 10.120.11.85 from /etc/resolv.conf Dec 28 10:03:00 dss-so92la05 squid[26940]: Adding nameserver 10.120.11.107 from /etc/resolv.conf Dec 28 10:03:00 dss-so92la05 squid[26940]: Adding domain dss.la.gov from /etc/resolv.conf Dec 28 10:03:00 dss-so92la05 squid[26940]: helperOpenServers: Starting 30 'WsRedtor' processes Dec 28 10:03:00 dss-so92la05 squid[26940]: logfileOpen: opening log /var/log/squid/access.log Dec 28 10:03:01 dss-so92la05 squid[26940]: Unlinkd pipe opened on FD 41 Dec 28 10:03:01 dss-so92la05 squid[26940]: Swap maxSize 16384000 + 262144 KB, estimated 0 objects Dec 28 10:03:01 dss-so92la05 squid[26940]: Target number of buckets: 64023 Dec 28 10:03:01 dss-so92la05 squid[26940]: Using 65536 Store buckets Dec 28 10:03:01 dss-so92la05 squid[26940]: Max Mem size: 262144 KB Dec 28 10:03:01 dss-so92la05 squid[26940]: Max Swap size: 16384000 KB Dec 28 10:03:01 dss-so92la05 squid[26940]: Store logging disabled Dec 28 10:03:01 dss-so92la05 squid[26940]: Rebuilding storage in /apps/squid/cache1 (CLEAN) Dec 28 10:03:01 dss-so92la05 squid[26940]: Rebuilding storage in /apps/squid/cache2 (CLEAN) Dec 28 10:03:01 dss-so92la05 squid[26940]: Rebuilding storage in /apps/squid/cache3 (CLEAN) Dec 28 10:03:01 dss-so92la05 squid[26940]: Rebuilding storage in /apps/squid/cache4 (CLEAN) Dec 28 10:03:01 dss-so92la05 squid[26940]: Using Least Load store dir selection Dec 28 10:03:01 dss-so92la05 squid[26940]: Current Directory is / Dec 28 10:03:01 dss-so92la05 squid[26940]: Loaded Icons. Dec 28 10:03:01 dss-so92la05 squid[26940]: Accepting proxy HTTP connections at 10.120.100.205, port 8080, FD 48. Dec 28 10:03:01 dss-so92la05 squid[26940]: Accepting ICP messages at 0.0.0.0, port 3130, FD 49. Dec 28 10:03:01 dss-so92la05 squid[26940]: WCCP Disabled. Dec 28 10:03:01 dss-so92la05 squid[26940]: Configuring 10.120.9.80 Parent 10.120.9.80/8080/3130 Dec 28 10:03:01 dss-so92la05 squid[26940]: Configuring 10.120.9.100 Parent 10.120.9.100/8080/3130 Dec 28 10:03:01 dss-so92la05 squid[26940]: Ready to serve requests. Dec 28 10:03:01 dss-so92la05 squid[26940]: Store rebuilding is 27.8% complete Dec 28 10:03:01 dss-so92la05 squid[26940]: Done reading /apps/squid/cache4 swaplog (13075 entries) Dec 28 10:03:01 dss-so92la05 squid[26940]: Done reading /apps/squid/cache1 swaplog (14731 entries) Dec 28 10:03:01 dss-so92la05 squid[26940]: Done reading /apps/squid/cache3 swaplog (14779 entries) Dec 28 10:03:01 dss-so92la05 squid[26940]: Done reading /apps/squid/cache2 swaplog (15337 entries) Dec 28 10:03:01 dss-so92la05 squid[26940]: Finished rebuilding storage from disk. Dec 28 10:03:01 dss-so92la05 squid[26940]: 57922 Entries scanned Dec 28 10:03:01 dss-so92la05 squid[26940]: 0 Invalid entries. Dec 28 10:03:01 dss-so92la05 squid[26940]: 0 With invalid flags. Dec 28 10:03:01 dss-so92la05 squid[26940]: 57922 Objects loaded. Dec 28 10:03:01 dss-so92la05 squid[26940]: 0 Objects expired. Dec 28 10:03:01 dss-so92la05 squid[26940]: 0 Objects cancelled. Dec 28 10:03:01 dss-so92la05 squid[26940]: 0 Duplicate URLs purged. Dec 28 10:03:01 dss-so92la05 squid[26940]: 0 Swapfile clashes avoided. Dec 28 10:03:01 dss-so92la05 squid[26940]: Took 0.5 seconds (121961.6 objects/sec). Dec 28 10:03:01 dss-so92la05 squid[26940]: Beginning Validation Procedure Dec 28 10:03:01 dss-so92la05 squid[26940]: Completed Validation Procedure Dec 28 10:03:01 dss-so92la05 squid[26940]: Validated 57922 Entries Dec 28 10:03:01 dss-so92la05 squid[26940]: store_swap_size = 929412k Dec 28 10:03:01 dss-so92la05 squid[26940]: WARNING: All url_rewriter processes are busy. Dec 28 10:03:01 dss-so92la05 squid[26940]: WARNING: up to 30 pending requests queued Dec 28 10:03:01 dss-so92la05 squid[26940]: storeLateRelease: released 0 objects Dec 28 10:03:31 dss-so92la05 squid[26940]: WARNING: All url_rewriter processes are busy. Dec 28 10:03:31 dss-so92la05 squid[26940]: WARNING: up to 154 pending requests queued Dec 28 10:03:31 dss-so92la05 squid[26940]: storeDirWriteCleanLogs: Starting... Dec 28 10:03:31 dss-so92la05 squid[26940]: WARNING: Closing open FD 48 Dec 28 10:03:31 dss-so92la05 squid[26940]: commSetEvents: epoll_ctl(EPOLL_CTL_DEL): failed on fd=48: (1) Operation not permitted Dec 28 10:03:31 dss-so92la05 squid[26940]: WARNING: Closing open FD 49 Dec 28 10:03:31 dss-so92la05 squid[26940]: commSetEvents: epoll_ctl(EPOLL_CTL_DEL): failed on fd=49: (1) Operation not permitted Dec 28 10:03:31 dss-so92la05 squid[26940]: Finished. Wrote 57925 entries. Dec 28 10:03:31 dss-so92la05 squid[26940]: Took 0.0 seconds (4941141.3 entries/sec). Dec 28 10:03:31 dss-so92la05 squid[26940]: Too many queued url_rewriter requests (154 on 30) Dec 28 10:03:31 dss-so92la05 squid[10675]: Squid Parent: child process 26940 exited due to signal 6 Dec 28 10:03:34 dss-so92la05 squid[10675]: Squid Parent: child process 27240 started Dec 28 10:03:34 dss-so92la05 squid[27240]: Starting Squid Cache version 2.7.STABLE6 for i686-pc-linux-gnu... Dec 28 10:03:34 dss-so92la05 squid[27240]: Process ID 27240 Dec 28 10:03:34 dss-so92la05 squid[27240]: With 4096 file descriptors available Dec 28 10:03:34 dss-so92la05 squid[27240]: Using epoll for the IO loop Dec 28 10:03:34 dss-so92la05 squid[27240]: DNS Socket created at 0.0.0.0, port 33382, FD 6 Dec 28 10:03:34 dss-so92la05 squid[27240]: Adding nameserver 10.120.11.85 from /etc/resolv.conf Dec 28 10:03:34 dss-so92la05 squid[27240]: Adding nameserver 10.120.11.107 from /etc/resolv.conf Dec 28 10:03:34 dss-so92la05 squid[27240]: Adding domain dss.la.gov from /etc/resolv.conf Dec 28 10:03:34 dss-so92la05 squid[27240]: helperOpenServers: Starting 30 'WsRedtor' processes Dec 28 10:03:35 dss-so92la05 squid[27240]: logfileOpen: opening log /var/log/squid/access.log Dec 28 10:03:35 dss-so92la05 squid[27240]: Unlinkd pipe opened on FD 41 Dec 28 10:03:35 dss-so92la05 squid[27240]: Swap maxSize 16384000 + 262144 KB, estimated 0 objects Dec 28 10:03:35 dss-so92la05 squid[27240]: Target number of buckets: 64023 Dec 28 10:03:35 dss-so92la05 squid[27240]: Using 65536 Store buckets Dec 28 10:03:35 dss-so92la05 squid[27240]: Max Mem size: 262144 KB Dec 28 10:03:35 dss-so92la05 squid[27240]: Max Swap size: 16384000 KB Dec 28 10:03:35 dss-so92la05 squid[27240]: Store logging disabled Dec 28 10:03:35 dss-so92la05 squid[27240]: Rebuilding storage in /apps/squid/cache1 (CLEAN) Dec 28 10:03:35 dss-so92la05 squid[27240]: Rebuilding storage in /apps/squid/cache2 (CLEAN) Dec 28 10:03:35 dss-so92la05 squid[27240]: Rebuilding storage in /apps/squid/cache3 (CLEAN) Dec 28 10:03:35 dss-so92la05 squid[27240]: Rebuilding storage in /apps/squid/cache4 (CLEAN) Dec 28 10:03:35 dss-so92la05 squid[27240]: Using Least Load store dir selection Dec 28 10:03:35 dss-so92la05 squid[27240]: Current Directory is / Dec 28 10:03:35 dss-so92la05 squid[27240]: Loaded Icons. Dec 28 10:03:35 dss-so92la05 squid[27240]: Accepting proxy HTTP connections at 10.120.100.205, port 8080, FD 48. Dec 28 10:03:35 dss-so92la05 squid[27240]: Accepting ICP messages at 0.0.0.0, port 3130, FD 49. Dec 28 10:03:35 dss-so92la05 squid[27240]: WCCP Disabled. Dec 28 10:03:35 dss-so92la05 squid[27240]: Configuring 10.120.9.80 Parent 10.120.9.80/8080/3130 Dec 28 10:03:35 dss-so92la05 squid[27240]: Configuring 10.120.9.100 Parent 10.120.9.100/8080/3130 Dec 28 10:03:35 dss-so92la05 squid[27240]: Ready to serve requests. Dec 28 10:03:35 dss-so92la05 squid[27240]: Store rebuilding is 27.8% complete Dec 28 10:03:35 dss-so92la05 squid[27240]: Done reading /apps/squid/cache4 swaplog (13074 entries) Dec 28 10:03:35 dss-so92la05 squid[27240]: Done reading /apps/squid/cache1 swaplog (14730 entries) Dec 28 10:03:35 dss-so92la05 squid[27240]: Done reading /apps/squid/cache3 swaplog (14782 entries) Dec 28 10:03:35 dss-so92la05 squid[27240]: Done reading /apps/squid/cache2 swaplog (15339 entries) Dec 28 10:03:35 dss-so92la05 squid[27240]: Finished rebuilding storage from disk. Dec 28 10:03:35 dss-so92la05 squid[27240]: 57925 Entries scanned Dec 28 10:03:35 dss-so92la05 squid[27240]: 0 Invalid entries. Dec 28 10:03:35 dss-so92la05 squid[27240]: 0 With invalid flags. Dec 28 10:03:35 dss-so92la05 squid[27240]: 57925 Objects loaded. Dec 28 10:03:35 dss-so92la05 squid[27240]: 0 Objects expired. Dec 28 10:03:35 dss-so92la05 squid[27240]: 0 Objects cancelled. Dec 28 10:03:35 dss-so92la05 squid[27240]: 0 Duplicate URLs purged. Dec 28 10:03:35 dss-so92la05 squid[27240]: 0 Swapfile clashes avoided. Dec 28 10:03:35 dss-so92la05 squid[27240]: Took 0.5 seconds (123329.2 objects/sec). Dec 28 10:03:35 dss-so92la05 squid[27240]: Beginning Validation Procedure Dec 28 10:03:35 dss-so92la05 squid[27240]: Completed Validation Procedure Dec 28 10:03:35 dss-so92la05 squid[27240]: Validated 57925 Entries Dec 28 10:03:35 dss-so92la05 squid[27240]: store_swap_size = 929424k Dec 28 10:03:36 dss-so92la05 squid[27240]: storeLateRelease: released 0 objects Dec 28 10:03:36 dss-so92la05 squid[27240]: WARNING: All url_rewriter processes are busy. Dec 28 10:03:36 dss-so92la05 squid[27240]: WARNING: up to 30 pending requests queued Dec 28 10:04:07 dss-so92la05 squid[27240]: WARNING: All url_rewriter processes are busy. Dec 28 10:04:07 dss-so92la05 squid[27240]: WARNING: up to 207 pending requests queued Dec 28 10:04:07 dss-so92la05 squid[27240]: Consider increasing the number of url_rewriter processes to at least 237 in your config file. -- Below is the sys info: dss-so92la05:~ # uname -a Linux dss-so92la05 2.6.16.60-0.42.5-bigsmp #1 SMP Mon Aug 24 09:41:41 UTC 2009 i686 i686 i386 GNU/Linux dss-so92la05:~ # rpm -qa | grep squid squid-2.7.STABLE6-1 -- >From squid.conf url_rewrite_children 60 url_rewrite_program /opt/Websense/bin/WsRedtor --- So, do I just change the rewriters to 237? Will that harm anything else? Thanks..
