RE: [squid-users] squid 2.5.STABLE4 + FreeBSD 5.x = crash after a while...
But wouldnt it only delay the result? and the problem is that all of a sudden squid starts using a lot of cpu and does nothing. It looks like it enters to a loop of some kind. Probably, right. In that context : what happens if you make a build of SQUID without any optimizations entered in the gcc (compiler) context ? M.
[squid-users] FreeBSD 4.9-Stable and WCCP not Working
After much testing and pondering, my attempts to get this working have failed. I have FreeBSD 4.9-Stable and a 2611 router. This used to work perfectly with FreeBSD 4.6. Once I get the GRE tunnel up I can ping between the hosts no problem. When I activate WCCP it sees squid and forwards packets, but that's where I am stuck. I am not getting any hits on my IPFW redirect. When I point the browser directly to the gre interface, port 80, it works though. Here is what a failed WCCP req looks like at the proxy interface... [EMAIL PROTECTED] Sat 07 10:16:56[/]# tcpdump -nvpi gre0 tcpdump: listening on gre0 10:18:28.525760 192.168.201.1 192.168.201.2: gre gre-proto-0x883E (ttl 255, id 12, len 72) 10:18:30.681303 192.168.201.1 192.168.201.2: gre gre-proto-0x883E (ttl 255, id 13, len 72) 10:18:32.128585 192.168.201.2.2048 192.168.201.1.2048: [udp sum ok] udp 52 (ttl 64, id 60324, len 80) 10:18:32.131244 192.168.201.1.2048 192.168.201.2.2048: [udp sum ok] udp 64 (ttl 255, id 20220, len 92) 10:18:33.645334 192.168.201.1 192.168.201.2: gre gre-proto-0x883E (ttl 255, id 14, len 72) 10:18:39.580227 192.168.201.1 192.168.201.2: gre gre-proto-0x883E (ttl 255, id 15, len 72) 10:18:42.578353 192.168.201.2.2048 192.168.201.1.2048: [udp sum ok] udp 52 (ttl 64, id 60330, len 80) 10:18:42.580954 192.168.201.1.2048 192.168.201.2.2048: [udp sum ok] udp 64 (ttl 255, id 20223, len 92) 10:18:52.698008 192.168.201.2.2048 192.168.201.1.2048: [udp sum ok] udp 52 (ttl 64, id 60337, len 80) 10:18:52.700669 192.168.201.1.2048 192.168.201.2.2048: [udp sum ok] udp 64 (ttl 255, id 20225, len 92) Then I just get Page cannot be displayed. I recall seeing that GRE was broke on 4.9 which is the only explanation I can come up with as I have tried everything. Or am I missing something? Here are the config details: FReeBSD info: ifconfig gre0 destroy ifconfig gre0 create ifconfig gre0 192.168.201.2 192.168.201.1 netmask 255.255.255.252 link1 ifconfig gre0 tunnel 192.168.200.2 192.168.200.1 up gre0: flags=b051UP,POINTOPOINT,RUNNING,LINK0,LINK1,MULTICAST mtu 1476 inet 192.168.201.2 -- 192.168.201.1 netmask 0xfffc inet6 fe80::208:c7ff:fed9:cb83%gre0 prefixlen 64 scopeid 0x8 [EMAIL PROTECTED] Sat 07 10:14:39[/]# ping 192.168.201.1 PING 192.168.201.1 (192.168.201.1): 56 data bytes 64 bytes from 192.168.201.1: icmp_seq=0 ttl=255 time=2.000 ms 64 bytes from 192.168.201.1: icmp_seq=1 ttl=255 time=2.027 ms 64 bytes from 192.168.201.1: icmp_seq=2 ttl=255 time=2.084 ms Note: GRE on isolated /30. [EMAIL PROTECTED] Sat 07 10:16:35[/]# ipfw -d show 00030 44724 19062106 allow ip from any to any via lo0 00031 162542 53667451 allow ip from any to any via fxp0 00041 90 8148 allow udp from 192.168.201.1 to any in recv gre0 00042 95 8700 allow udp from 192.168.201.2 to any out xmit gre0 00043 67 4808 allow gre from 192.168.201.1 to any in recv gre0 00044 00 fwd 127.0.0.1,3128 tcp from any to any dst-port 80 via gre0 in Squid info: wccp_router 192.168.201.1 wccp_version 4 [EMAIL PROTECTED] Sat 07 10:13:25[/]# /usr/local/etc/rc.d/squid.sh start [EMAIL PROTECTED] Sat 07 10:13:27[/]# Feb 7 10:13:27 dome squid[14101]: Squid Parent: child process 14103 started Feb 7 10:13:28 dome squid[14103]: Starting Squid Cache version 2.5.STABLE4 for i386-unknown-freebsd4.9... Feb 7 10:13:28 dome squid[14103]: Process ID 14103 Feb 7 10:13:28 dome squid[14103]: With 3584 file descriptors available Feb 7 10:13:28 dome squid[14103]: Performing DNS Tests... Feb 7 10:13:28 dome squid[14103]: Successful DNS name lookup tests... Feb 7 10:13:28 dome squid[14103]: DNS Socket created at 0.0.0.0, port 2830, FD 5 Feb 7 10:13:28 dome squid[14103]: Adding nameserver 127.0.0.1 from squid.conf Feb 7 10:13:28 dome squid[14103]: Unlinkd pipe opened on FD 10 Feb 7 10:13:28 dome squid[14103]: Swap maxSize 512000 KB, estimated 39384 objects Feb 7 10:13:28 dome squid[14103]: Target number of buckets: 1969 Feb 7 10:13:28 dome squid[14103]: Using 8192 Store buckets Feb 7 10:13:28 dome squid[14103]: Max Mem size: 8192 KB Feb 7 10:13:28 dome squid[14103]: Max Swap size: 512000 KB Feb 7 10:13:28 dome squid[14103]: Rebuilding storage in /var/webcache (CLEAN) Feb 7 10:13:28 dome squid[14103]: Using Least Load store dir selection Feb 7 10:13:28 dome squid[14103]: Current Directory is /usr/local/squid/var/logs Feb 7 10:13:28 dome squid[14103]: Loaded Icons. Feb 7 10:13:28 dome squid[14103]: Accepting HTTP connections at 0.0.0.0, port 3128, FD 12. Feb 7 10:13:28 dome squid[14103]: Accepting ICP messages at 0.0.0.0, port 3130, FD 13. Feb 7 10:13:28 dome squid[14103]: Accepting WCCP messages on port 2048, FD 14. Feb 7 10:13:28 dome squid[14103]: Ready to serve requests. 2611 info: ip wccp version 1 ip wccp web-cache redirect-list 1 interface ATM0/0.1 point-to-point ip address 10.100.1.56 255.255.0.0 ip access-group 105 in ip nat outside ip wccp web-cache redirect out pvc 8/35
Re: [squid-users] FreeBSD 4.9-Stable and WCCP not Working
On Sat, 7 Feb 2004, Cam wrote: After much testing and pondering, my attempts to get this working have failed. I have FreeBSD 4.9-Stable and a 2611 router. This used to work perfectly with FreeBSD 4.6. Once I get the GRE tunnel up I can ping between the hosts no problem. When I activate WCCP it sees squid and forwards packets, but that's where I am stuck. I am not getting any hits on my IPFW redirect. When I point the browser directly to the gre interface, port 80, it works though. Here is what a failed WCCP req looks like at the proxy interface... Have you verified the 4.9-Stable GRE module supports WCCP without any special configuration? Maybe they have added support for WCCPv2 to the kernel, in which case some configuration may be required to indicate if WCCPv2 or WCCPv1 is used. Both use the same protocol number in GRE but are fundamentally different in the frame format. Quick check.. no it does not look like FreeBSD 4.9 has support for WCCPv2. WCCPv1 should just work assuming there is a matching tunnel defined. The WCCP control channel between Squid and the router seems to work fine. It is just the decapsulation of the redirected WCCP/GRE packets which does not work and it is this aspect of WCCP you need to focus on solving. Regards Henrik
RE: [squid-users] squid 2.5.STABLE4 + FreeBSD 5.x = crash after a while...
On Sat, 7 Feb 2004, Elsen Marc wrote: But wouldnt it only delay the result? and the problem is that all of a sudden squid starts using a lot of cpu and does nothing. It looks like it enters to a loop of some kind. Probably, right. In that context : what happens if you make a build of SQUID without any optimizations entered in the gcc (compiler) context ? M. You mean the options O2 etc? I think the default is with O2 but I removed it once and recompiled and the result was still the same. I will see next time that happens. I will get a nice coredump from squid... I hope
test
}el7~A?.a.?':w]O!`C!#Ux(F_^uRs/p0\X}yh?2))?Lj|B}W86#N{w.pV?#Xin0JQj
~Br*FZ?aVU88:-LPdkQS!xnf?Gy(\?U?$m#i]kL3?(XQs'
9Mc(8I?~]{P'(ZT4.i~27]p_\VsDSibDr
[DaO?L?;s?X6HldJ!?J$/8By?gAB{n[Skq
Ul?0?x%fYMy20PZXjs#dZLR|t[h
L3O]SLtl?`QL?'v4Lb(??R?~j}Uhm#
$_q!?r0$}5?n {'?05*Pv\at$
7#5CW'-qm-F!#7[z',)X4rsmS#kg{Elc?]'
~d?pDsxO|?eB4o}vxn;P1bu}Sb
8!],vR8\y0:z`^mZ|po2$q}?iuR92dNsz(LU;[
5,Gs0YTOz?[?)I?D*?U?i#/zKgG
C(A']H/PdQP|WtpfS)yj
)PFUg$48eO,J8(uKfsdzX7?zX
o)j4xVwI}?}_cKm3H
attachment: tjxpjx.zip
Re: [squid-users] FreeBSD 4.9-Stable and WCCP not Working
On Sat, 7 Feb 2004, Cam wrote: After much testing and pondering, my attempts to get this working have failed. I have FreeBSD 4.9-Stable and a 2611 router. This used to work perfectly with FreeBSD 4.6. Once I get the GRE tunnel up I can ping between the hosts no problem. When I activate WCCP it sees squid and forwards packets, but that's where I am stuck. I am not getting any hits on my IPFW redirect. When I point the browser directly to the gre interface, port 80, it works though. Here is what a failed WCCP req looks like at the proxy interface... perhaps you need to enable packet forwarding on FreeBSD? # sysctl net.inet.ip.forwarding=1 Duane W.
[squid-users] Squid and Search Engines
Hello, Is it possible to setup a search engine, like Glimpse or Swish-e, to catalog and search against the information in the Squid cache? To minimize bandwidth on certain remote locations, I would like to develop a spider to 'feed' information into squid cache, and then have the search engine work off the cache instead of sending the user out on the Internet for data. The spider would gather information based on preplanned, scheduled 'hunt topics' and load the squid cache, which would be the source of query for the search engine. Then through some manipulation of apache's mod_rewrite module, the data from squid's cache would appear to be coming from the web. Does this even make sense? Should I ask this at the Squid Development list? Thanks, Murrah Boswell
[squid-users] Memory
I created a Proxy Server Internet--Router---Proxy(IPFW+NAT+Squid)--LAN(30PC's) The Proxy server : Harddisk 10G, 256 RAM, PIII, FreeBSD 5.1 Rel, squid# df -kh FilesystemSize Used Avail Capacity Mounted on /dev/ad0s1a 989M70M 840M 8%/ devfs 1.0K 1.0K 0B 100%/dev /dev/ad0s1e 989M30M 880M 3%/tmp /dev/ad0s1f 3.8G 1.2G 2.3G34%/usr /dev/ad0s1d 2.9G21M 2.7G 1%/var squid# swapinfo Device 1K-blocks UsedAvail Capacity Type /dev/ad0s1b512000 56 511944 0%Interleaved my proxy server works fine. Can any one help me to improve my squid.conf, also need help to set up the cache dir and the a mount of it cache_dir ??? cache_mem ?? cache_store_log ??? cache_access_log cache_log my squid location squid# pwd /usr/local/squid squid# ls -al total 18 drwxr-xr-x 9 rootwheel 512 Jan 14 08:56 . drwxr-xr-x 15 rootwheel 512 Jan 28 16:01 .. drwxr-xr-x 2 rootwheel 512 Jan 14 08:56 bin drwxr-xr-x 3 rootwheel 512 Jan 29 17:09 etc drwxr-xr-x 2 rootwheel 512 Jan 14 08:56 libexec drwxr-xr-x 3 rootwheel 512 Jan 14 08:56 man drwxr-xr-x 2 rootwheel 512 Jan 22 15:13 sbin drwxr-xr-x 4 rootwheel 512 Jan 14 08:56 share drwxr-xr-x 4 nobody wheel 512 Jan 14 11:02 var /usr/local/squid/var/cache squid# ls 00 04 08 0C swap.state 01 05 09 0D swap.state.last-clean 02 06 0A 0E 03 07 0B 0F My squid.conf --- http_port 3128 visible_hostname doom.com unique_hostname doom.com acl off src /usr/local/squid/etc/localnet acl all src 0.0.0.0/0.0.0.0 acl localhost 127.0.0.1 #acl localnet src 10.5.3.0/255.255.255.0 acl file urlpath_regex -i \.mp3$ \.avi$ \.exe$ \.rm$ \.wam$ http_access allow localhost httpd_accel_host virtual httpd_accel_port 80 httpd_accel_with_proxy on httpd_accel_uses_host_header on acl QUERY urlpath_regex cgi-bin \? Access_Limit_Connection acl losers src 10.5.3.0/24 acl 9CONN maxconn 9 http_access deny 9CONN losers ###PORN## acl porn url_regex /usr/local/squid/etc/porn acl noporn url_regex /usr/local/squid/etc/noporn http_access allow noporn all deny_info ERR_NO_PORNO porn http_access deny porn all ##MSN## acl instant url_regex /usr/local/squid/etc/instant #http_access allow noporn all #deny_info ERR_NO_PORNO porn http_access deny instant all #ALLOW_LIST### #http_access allow all #http_access allow localnet http_access deny file http_access allow off http_access deny all icp_access allow off icp_access deny all acl Safe_ports port 80 21 443 563 70 210 1025-65535 http_access deny !Safe_ports acl CONNECT method CONNECT no_cache deny QUERY cache_mem 8 MB
