Re: [squid-users] I/O Performance Tuning
confuse to define coss parameter in squid.conf cache_dir coss /cache1 12 max-size=524288 block-size=64 mount point= /cache1 harddisk size 120 GB= 12 max-size object= ? block-size = ? Henrik Nordstrom-5 wrote: > > sön 2009-09-06 klockan 07:26 -0700 skrev pokeman: >> Thanks henrik for your tip can you guide me what is the recomended >> setting >> for coss .2ndly currenly i am using aufs . after enabling coss what >> heppen >> with store cache object. coss required to use clean disk . > > You can use both coss & aufs on the same drive. To keep config clean > just move the aufs data down to a folder below the root of that disk. > > cd /cache > mkdir aufs > mv ?? swap.state* aufs > mkdir coss1 > [repeat for as many coss stores you need] > > then reconfigure squid as appropriate. > > Regards > Henrik > > > -- View this message in context: http://www.nabble.com/I-O-Performance-Tuning-tp25307139p25325717.html Sent from the Squid - Users mailing list archive at Nabble.com.
Re: [squid-users] I/O Performance Tuning
Thanks henrik for your tip can you guide me what is the recomended setting for coss .2ndly currenly i am using aufs . after enabling coss what heppen with store cache object. coss required to use clean disk . Henrik Nordstrom-5 wrote: > > lör 2009-09-05 klockan 03:52 -0700 skrev pokeman: >> Hello >> >> Today i have seen some issue with Disk I/O performance issue can any >> tell me how to improve that ! > > Well, it seems you are running the cache on a single HDD. This won't > scale well and you will be limited by the number of seeks/s the drive > can handle. > > Using COSS can lighten that somewhat thanks to not needing any I/O to > reclaim space and less I/O operations to write things out, but still.. > > Regards > Henrik > > > -- View this message in context: http://www.nabble.com/I-O-Performance-Tuning-tp25307139p25318293.html Sent from the Squid - Users mailing list archive at Nabble.com.
Re: [squid-users] I/O Performance Tuning
well i have seen problem to deliver website via squid or origin server . in peek hours the squid could not given performance instead of non-peek hours. we have lots of spare bandwidth but user could not get appropriate speed Amos Jeffries-2 wrote: > > pokeman wrote: >> Hello >> >> Today i have seen some issue with Disk I/O performance issue can any >> tell me how to improve that ! > > Please describe what you think the issue is. > > "performance" is not a sufficiently descriptive problem statement. Your > cache is doing a respectable 200 req/sec and filling a 10Mbps network > pipe to full capacity. > > > BTW: are you seeing any problems with bad data going to clients when > those websites you store DNS for 60 hours without checking for changes > happen to change? > > Amos > -- > Please be using >Current Stable Squid 2.7.STABLE6 or 3.0.STABLE18 >Current Beta Squid 3.1.0.13 > > -- View this message in context: http://www.nabble.com/I-O-Performance-Tuning-tp25307139p25314847.html Sent from the Squid - Users mailing list archive at Nabble.com.
[squid-users] I/O Performance Tuning
Hello Today i have seen some issue with Disk I/O performance issue can any tell me how to improve that ! # squidinfo Connection information for squid: Number of clients accessing cache: 0 Number of HTTP requests received: 422259 Number of ICP messages received:0 Number of ICP messages sent:0 Number of queued ICP replies: 0 Request failure ratio: 0.00 Average HTTP requests per minute since start: 12157.7 Average ICP messages per minute since start:0.0 Select loop called: 4180430 times, 0.498 ms avg Cache information for squid: Request Hit Ratios: 5min: 19.1%, 60min: 20.1% Byte Hit Ratios:5min: 9.9%, 60min: 9.6% Request Memory Hit Ratios: 5min: 19.3%, 60min: 20.8% Request Disk Hit Ratios:5min: 61.6%, 60min: 53.3% Storage Swap size: 169917856 KB Storage Mem size: 126032 KB Mean Object Size: 49.83 KB Requests given to unlinkd: 0 Median Service Times (seconds) 5 min60 min: HTTP Requests (All): 0.42149 0.39928 Cache Misses: 0.42149 0.39928 Cache Hits:0.46965 0.52331 Near Hits: 0.94847 0.89858 Not-Modified Replies: 0.12106 0.00286 DNS Lookups: 0.0 0.0 ICP Queries: 0.0 0.0 Resource usage for squid: UP Time:2083.915 seconds CPU Time: 455.501 seconds CPU Usage: 21.86% CPU Usage, 5 minute avg:20.97% CPU Usage, 60 minute avg: 21.88% Process Data Segment Size via sbrk(): 728820 KB Maximum Resident Size: 0 KB Page faults with physical i/o: 9 Memory usage for squid via mallinfo(): Total space in arena: 728952 KB Ordinary blocks: 703156 KB 15798 blks Small blocks: 0 KB 0 blks Holding blocks: 96620 KB 8 blks Free Small blocks: 0 KB Free Ordinary blocks: 25795 KB Total in use: 799776 KB 97% Total free: 25795 KB 3% Total size:825572 KB Memory accounted for: Total accounted: 501426 KB memPoolAlloc calls: 76354783 memPoolFree calls: 69149858 File descriptor usage for squid: Maximum number of file descriptors: 64000 Largest file desc currently in use: 3491 Number of file desc currently in use: 2700 Files queued for open: 25 Available number of file descriptors: 61275 Reserved number of file descriptors: 100 Store Disk files open: 254 IO loop method: epoll Internal Data Structures: 3418559 StoreEntries 14446 StoreEntries with MemObjects 13569 Hot Object Cache Items 3410021 on-disk objects Store Directory Statistics: Store Entries : 3418561 Maximum Swap Size : 18432 KB Current Store Swap Size: 169917840 KB Current Capacity : 92% used, 8% free Store Directory #0 (aufs): /cache1 FS Block Size 4096 Bytes First level subdirectories: 64 Second level subdirectories: 256 Maximum Size: 6144 KB Current Size: 55189460 KB Percent Used: 89.83% Current load metric: 1045 / 1000 Filemap bits in use: 1011127 of 2097152 (48%) Filesystem Space in use: 71357340/76920416 KB (93%) Filesystem Inodes in use: 2113612/4890624 (43%) Flags: Accepted object sizes: 0 - (unlimited) bytes Removal policy: heap Store Directory #1 (aufs): /cache2 FS Block Size 4096 Bytes First level subdirectories: 128 Second level subdirectories: 256 Maximum Size: 12288 KB Current Size: 114728380 KB Percent Used: 93.37% Current load metric: 1045 / 1000 Filemap bits in use: 2399082 of 4194304 (57%) Filesystem Space in use: 116823500/153834852 KB (76%) Filesystem Inodes in use: 4227212/9773056 (43%) Flags: Accepted object sizes: 0 - (unlimited) bytes Removal policy: heap # iotop Total DISK READ: 2.20 M/s | Total DISK WRITE: 157.73 K/s TID PRIO USER DISK READ DISK WRITE SWAPIN IO>COMMAND 1687 rt/0 squid 7.51 K/s0.00 B/s 0.00 % 99.99 % (squid) -D -f /etc/squid/squid.conf 1673 rt/0 squid 548.30 K/s 15.02 K/s 0.00 % 99.99 % (squid) -D -f /etc/squid/squid.conf 1684 rt/0 squid 0.00 B/s0.00 B/s 0.00 % 99.99 % (squid) -D -f /etc/squid/squid.conf 1681 rt/0 squid 37.56 K/s0.00 B/s 0.00 % 99.99 % (squid) -D -f /etc/squid/squid.conf 1665 rt/0 squid 3.76 K/s 450.66 K/s 0.00 % 99.99 % (squid) -D -f /etc/squid/squid.conf 1683 rt/0 squid 3.76 K/s0.00 B/s 0.00 % 99.99 % (squid) -D -f /etc/squid/squid.conf 1674 rt/0 squid 401.84 K/s3.76 K/s 0.00 % 99.99 % (squid) -D -f /etc/squid/squid.conf 1686 rt/0 squid 146.46 K/s 435.64 K/s 0.00 % 99.99 % (squid) -D -f /etc/squid/squid.conf 1670 rt/0 squid 184.02 K/s 75.11 K/s 0.00 % 99.99 %
Re: [squid-users] StoreUrlRewrite + url_rewrite_program
Thanks for your prompt response i am using custom url-rewrite script to catch and save object like same as videocache. the only issue they cannot catch youtube. the idea store-urlrewrite to save youtube object. one more thing i am think about that currenlty i have over 500 GB content save in my httpd server. and squid have only 200 gb cache drives. after implement store_rewrite we need to add more storage. any other why to save this object istead of squid save in my httpd server. Amos Jeffries-2 wrote: > > pokeman wrote: >> Hello >> can i use StoreUrlRewrite + url_rewrite_program at the same time ? >> > > Yes. You can use any two directives in squid.conf at the same time. How > they interact is another matter. > > I'm not sure what the effect on reliability of your cache would be when > you actually fetch an object from URL-X and then store it with URL-Z > then pass it to the client claiming its URL-Y. > > Consider VERY carefully and beware of dragons. > > Amos > -- > Please be using >Current Stable Squid 2.7.STABLE6 or 3.0.STABLE18 >Current Beta Squid 3.1.0.13 > > -- View this message in context: http://www.nabble.com/StoreUrlRewrite-%2B-url_rewrite_program-tp25236859p25237905.html Sent from the Squid - Users mailing list archive at Nabble.com.
[squid-users] StoreUrlRewrite + url_rewrite_program
Hello can i use StoreUrlRewrite + url_rewrite_program at the same time ? -- View this message in context: http://www.nabble.com/StoreUrlRewrite-%2B-url_rewrite_program-tp25236859p25236859.html Sent from the Squid - Users mailing list archive at Nabble.com.
Re: [squid-users] Tproxy Iptables + ebtables Problem
no answer ? pokeman wrote: > > Hello > one of my server FC11 x64 bit running Tproxy with combination of iptables > + ebtables rules during peek hours machine was crash with given such as > error "kernel panic " . when i replace tproxy with netfilter and remove > ebtables rules just use simple iptables with NAT rules everything was > fine. anyone faced this issue before ? > > http://www.nabble.com/file/p25184594/IMG0115A.jpg > -- View this message in context: http://www.nabble.com/Tproxy-Iptables-%2B-ebtables-Problem-tp25184594p25203697.html Sent from the Squid - Users mailing list archive at Nabble.com.
[squid-users] Large content storedir
How to retrive list of large object save in my cache drives so i can purge it -- View this message in context: http://www.nabble.com/Large-content-storedir-tp25186793p25186793.html Sent from the Squid - Users mailing list archive at Nabble.com.
[squid-users] Tproxy Iptables + ebtables Problem
Hello one of my server FC11 x64 bit running Tproxy with combination of iptables + ebtables rules during peek hours machine was crash with given such as error "kernel panic " . when i replace tproxy with netfilter and remove ebtables rules just use simple iptables with NAT rules everything was fine. anyone faced this issue before ? http://www.nabble.com/file/p25184594/IMG0115A.jpg -- View this message in context: http://www.nabble.com/Tproxy-Iptables-%2B-ebtables-Problem-tp25184594p25184594.html Sent from the Squid - Users mailing list archive at Nabble.com.
[squid-users] list of squidclient mgr: options
Hello can anyone post list of available squidclient mgr: options available Thanks -- View this message in context: http://www.nabble.com/list-of-squidclient-mgr%3A-options-tp25166454p25166454.html Sent from the Squid - Users mailing list archive at Nabble.com.
[squid-users] can i use refresh_patten with url_regex file
Hello i have over 2000 domains list in file can this posible to add single line tag in squid.conf via url_path_regex refresh_pattern urlpath_regex -i "/extra/tuning/sitesupdate" 10080 90% 43200 reload-into-ims -- View this message in context: http://www.nabble.com/can-i-use-refresh_patten-with-url_regex-file-tp25149397p25149397.html Sent from the Squid - Users mailing list archive at Nabble.com.
Re: [squid-users] squid + router error
:(( no reply pokeman wrote: > > hi there > > i am using squid box with nated router , squid configure transparent proxy > with iptables the configuration > linux box > here is snap shot > > http://wiki.mikrotik.com/wiki/Image:Squidbox.JPG > > eth0 public ip 111.222.222.111/29 > eth1 private ip 192.168.0.1/24 > > then NAT router > > ether1 private ip 192.168.0.5/24 > ether2 lan for network 172.16.0.0/20 > > user connected with nat router and all request forword to the squid box > iptables . then iptables redirect 80 port to 8080 port > > Error ! hotmail can not signup page given error after submit the form > > We are working to fix a temporary problem with our sign-up service. > > Please try again. > > If you continue to get this error try again later. > > OK > Error code: 100 : 0x800482d4 : 2008-08-25T16:20:09 GMT > > if i remove the browse the internet directly to the squid box its working > fine i am using squid 2.7 > > > -- View this message in context: http://www.nabble.com/squid-%2B-router-error-tp19146930p19156093.html Sent from the Squid - Users mailing list archive at Nabble.com.
[squid-users] squid + router error
hi there i am using squid box with nated router , squid configure transparent proxy with iptables the configuration linux box eth0 public ip 111.222.222.111/29 eth1 private ip 192.168.0.1/24 then NAT router ether1 private ip 192.168.0.5/24 ether2 lan for network 172.16.0.0/20 user connected with nat router and all request forword to the squid box iptables . then iptables redirect 80 port to 8080 port Error ! hotmail can not signup page given error after submit the form We are working to fix a temporary problem with our sign-up service. Please try again. If you continue to get this error try again later. OK Error code: 100 : 0x800482d4 : 2008-08-25T16:20:09 GMT if i remove the browse the internet directly to the squid box its working fine i am using squid 2.7 -- View this message in context: http://www.nabble.com/squid-%2B-router-error-tp19146930p19146930.html Sent from the Squid - Users mailing list archive at Nabble.com.
Re: [squid-users] cached MS updates !
thanks henrik for you reply any other way to save bandwidth windows updates almost use 30% of my entire bandwidth Henrik Nordstrom-5 wrote: > > On sön, 2008-06-15 at 06:40 -0700, pokeman wrote: >> no one explane this :((( > > Didn't understand there was a question. > > What is the question? > >> > 1213248111.272979 192.168.0.5 TCP_MISS/206 44097 GET >> > >> http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf >> > - DIRECT/8.12.137.30 multipart/byteranges > > I guess you ask whi this isn't cached, it's because it's a partial > request, only requesting parts of the object, and Squid can not yet > cache partial objects. > > Regards > Henrik > > > -- View this message in context: http://www.nabble.com/cached-MS-updates-%21-tp17792708p17866715.html Sent from the Squid - Users mailing list archive at Nabble.com.
Re: [squid-users] cached MS updates !
no one explane this :(((
pokeman wrote:
>
> hi there
> Refrence to following atricle
> http://www.nabble.com/Re%3A-YouTube-and-other-streaming-media-%28caching%29-p17738020.html
> i am going to cached windowsupdate object here is changes in store script
> in squid.conf and output log
>
> Squid.conf
> acl store_rewrite_list url_regex ^http://(.*?)/windowsupdate\?
>
> refresh_pattern windowsupdate.com/.*\.(cab|exe|dll) 10080 90% 99
> ignore-no-cache override-expire ignore-private
> refresh_pattern download.microsoft.com/.*\.(cab|exe|dll) 10080 90% 99
> ignore-no-cache override-expire ignore-private
> refresh_pattern au.download.windowsupdate.com/.*\.(cab|exe|psf) 10080 90%
> 99 ignore-no-cache override-expire ignore-private
> refresh_pattern ^http://sjl-v[0-9]+\.sjl\.youtube\.com 10080 90% 99
> ignore-no-cache override-expire ignore-private
>
> #Store script
>
> #!/usr/bin/perl
> $|=1;
> while (<>) {
> @X = split;
> $url = $X[0];
> $url =~
> [EMAIL PROTECTED]://(.*?)/get_video\?(.*)video_id=(.*?)&[EMAIL
> PROTECTED]://videos.youtube.INTERNAL/ID=$3@;
> $url =~
> [EMAIL PROTECTED]://(.*?)/get_video\?(.*)video_id=(.*?)[EMAIL
> PROTECTED]://videos.youtube.INTERNAL/ID=$3@;
> $url =~
> [EMAIL PROTECTED]://(.*?)/videodownload\?(.*)docid=(.*?)[EMAIL
> PROTECTED]://videos.google.INTERNAL/ID=$3@;
> $url =~
> [EMAIL PROTECTED]://(.*?)/videodownload\?(.*)docid=(.*?)&[EMAIL
> PROTECTED]://videos.google.INTERNAL/ID=$3@;
> $url =~
> [EMAIL PROTECTED]://(.*?)/update\?(.*)video_id=(.*?)&[EMAIL
> PROTECTED]://au.download.windowsupdate.com.INTERNAL/ID=$3@;
> $url =~
> [EMAIL PROTECTED]://(.*?)/update\?(.*)video_id=(.*?)[EMAIL
> PROTECTED]://au.download.windowsupdate.com.INTERNAL/ID=$3@;
> print "$url\n";
> }
>
> ### output cache log
> 1213248096.431606 192.168.0.5 TCP_MISS/206 15348 GET
> http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
> - DIRECT/199.93.42.124 application/octet-stream
> 1213248098.070905 192.168.0.5 TCP_MISS/206 36487 GET
> http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
> - DIRECT/199.93.42.124 multipart/byteranges
> 1213248099.996 1535 192.168.0.5 TCP_MISS/206 40838 GET
> http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
> - DIRECT/8.12.137.30 multipart/byteranges
> 1213248101.372 1216 192.168.0.5 TCP_MISS/206 14687 GET
> http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
> - DIRECT/209.84.7.123 application/octet-stream
> 1213248101.749202 192.168.0.5 TCP_MISS/200 375 HEAD
> http://download.windowsupdate.com/v7/windowsupdate/redir/wuredir.cab?0806120622
> - DIRECT/79.140.80.33 application/octet-stream
> 1213248102.091606 192.168.0.5 TCP_MISS/206 12929 GET
> http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
> - DIRECT/209.84.7.123 application/octet-stream
> 1213248103.755962 192.168.0.5 TCP_MISS/206 33762 GET
> http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
> - DIRECT/209.84.7.123 multipart/byteranges
> 1213248104.624578 192.168.0.5 TCP_MISS/200 375 HEAD
> http://www.update.microsoft.com/v7/windowsupdate/selfupdate/wuident.cab?0806120623
> - DIRECT/65.55.13.158 application/octet-stream
> 1213248104.831100 192.168.0.5 TCP_MISS/200 376 HEAD
> http://download.windowsupdate.com/v7/windowsupdate/a/selfupdate/WSUS3/x86/Other/wsus3setup.cab?0806120623
> - DIRECT/79.140.80.33 application/octet-stream
> 1213248105.266431 192.168.0.5 TCP_MISS/200 25737 GET
> http://download.windowsupdate.com/v7/windowsupdate/a/selfupdate/WSUS3/x86/Other/wsus3setup.cab?0806120623
> - DIRECT/79.140.80.33 application/octet-stream
> 1213248105.638 1529 192.168.0.5 TCP_MISS/206 36542 GET
> http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
> - DIRECT/199.93.42.124 application/octet-stream
> 1213248106.175409 192.168.0.5 TCP_MISS/206 13595 GET
> http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
> - DIRECT/199.93.42.124 multipart/byteranges
> 1213248106.595102 192.168.0.5 TCP_MISS/200 375 HEAD
> http://download.windowsupdate.com/v7/windowsupdate/redir/wuredir.cab?0806120623
> - DIRECT/79.140.8
[squid-users] cached MS updates !
hi there
Refrence to following atricle
http://www.nabble.com/Re%3A-YouTube-and-other-streaming-media-%28caching%29-p17738020.html
i am going to cached windowsupdate object here is changes in store script in
squid.conf and output log
Squid.conf
acl store_rewrite_list url_regex ^http://(.*?)/windowsupdate\?
refresh_pattern windowsupdate.com/.*\.(cab|exe|dll) 10080 90% 99
ignore-no-cache override-expire ignore-private
refresh_pattern download.microsoft.com/.*\.(cab|exe|dll) 10080 90% 99
ignore-no-cache override-expire ignore-private
refresh_pattern au.download.windowsupdate.com/.*\.(cab|exe|psf) 10080 90%
99 ignore-no-cache override-expire ignore-private
refresh_pattern ^http://sjl-v[0-9]+\.sjl\.youtube\.com 10080 90% 99
ignore-no-cache override-expire ignore-private
#Store script
#!/usr/bin/perl
$|=1;
while (<>) {
@X = split;
$url = $X[0];
$url =~
[EMAIL PROTECTED]://(.*?)/get_video\?(.*)video_id=(.*?)&[EMAIL
PROTECTED]://videos.youtube.INTERNAL/ID=$3@;
$url =~
[EMAIL PROTECTED]://(.*?)/get_video\?(.*)video_id=(.*?)[EMAIL
PROTECTED]://videos.youtube.INTERNAL/ID=$3@;
$url =~
[EMAIL PROTECTED]://(.*?)/videodownload\?(.*)docid=(.*?)[EMAIL
PROTECTED]://videos.google.INTERNAL/ID=$3@;
$url =~
[EMAIL PROTECTED]://(.*?)/videodownload\?(.*)docid=(.*?)&[EMAIL
PROTECTED]://videos.google.INTERNAL/ID=$3@;
$url =~
[EMAIL PROTECTED]://(.*?)/update\?(.*)video_id=(.*?)&[EMAIL
PROTECTED]://au.download.windowsupdate.com.INTERNAL/ID=$3@;
$url =~
[EMAIL PROTECTED]://(.*?)/update\?(.*)video_id=(.*?)[EMAIL
PROTECTED]://au.download.windowsupdate.com.INTERNAL/ID=$3@;
print "$url\n";
}
### output cache log
1213248096.431606 192.168.0.5 TCP_MISS/206 15348 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/199.93.42.124 application/octet-stream
1213248098.070905 192.168.0.5 TCP_MISS/206 36487 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/199.93.42.124 multipart/byteranges
1213248099.996 1535 192.168.0.5 TCP_MISS/206 40838 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/8.12.137.30 multipart/byteranges
1213248101.372 1216 192.168.0.5 TCP_MISS/206 14687 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/209.84.7.123 application/octet-stream
1213248101.749202 192.168.0.5 TCP_MISS/200 375 HEAD
http://download.windowsupdate.com/v7/windowsupdate/redir/wuredir.cab?0806120622
- DIRECT/79.140.80.33 application/octet-stream
1213248102.091606 192.168.0.5 TCP_MISS/206 12929 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/209.84.7.123 application/octet-stream
1213248103.755962 192.168.0.5 TCP_MISS/206 33762 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/209.84.7.123 multipart/byteranges
1213248104.624578 192.168.0.5 TCP_MISS/200 375 HEAD
http://www.update.microsoft.com/v7/windowsupdate/selfupdate/wuident.cab?0806120623
- DIRECT/65.55.13.158 application/octet-stream
1213248104.831100 192.168.0.5 TCP_MISS/200 376 HEAD
http://download.windowsupdate.com/v7/windowsupdate/a/selfupdate/WSUS3/x86/Other/wsus3setup.cab?0806120623
- DIRECT/79.140.80.33 application/octet-stream
1213248105.266431 192.168.0.5 TCP_MISS/200 25737 GET
http://download.windowsupdate.com/v7/windowsupdate/a/selfupdate/WSUS3/x86/Other/wsus3setup.cab?0806120623
- DIRECT/79.140.80.33 application/octet-stream
1213248105.638 1529 192.168.0.5 TCP_MISS/206 36542 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/199.93.42.124 application/octet-stream
1213248106.175409 192.168.0.5 TCP_MISS/206 13595 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/199.93.42.124 multipart/byteranges
1213248106.595102 192.168.0.5 TCP_MISS/200 375 HEAD
http://download.windowsupdate.com/v7/windowsupdate/redir/wuredir.cab?0806120623
- DIRECT/79.140.80.33 application/octet-stream
1213248108.882 1832 192.168.0.5 TCP_MISS/206 45373 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/8.12.137.30 application/octet-stream
1213248109.603608 192.168.0.5 TCP_MISS/206 16132 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/8.12.137.30 application/octet-stream
121324
Re: [squid-users] squid 2.7 with windowsupdate :(
i just searching on net got following link http://www.mail-archive.com/squid-users@squid-cache.org/msg51225.html as ref nessory compile with --enable-openssl in 2.7 ? i am using fedora 9 here is my compile options Squid Cache: Version 2.7.STABLE2-20080607 configure options: '--disable-poll' '--enable-removal-policies=lru,heap' '--disable-ident-lookups' '--enable-delay-pools' '--enable-async-io' '--with-pthreads' '--enable-storeio=diskd,aufs' '--enable-useragent-log' '--enable-referer-log' '--disable-dependency-tracking' '--enable-truncate' '--enable-underscores--enable-arp-acl' '--enable-x-accelerator-vary' '--enable-follow-x-forwarded-for' pokeman wrote: > > do you found any error in my configuration > > here is log > > 2008/06/08 15:57:58| WARNING: store_rewriter #1 (FD 7) exited > 2008/06/08 15:57:58| WARNING: store_rewriter #2 (FD 8) exited > 2008/06/08 15:57:58| WARNING: store_rewriter #3 (FD 9) exited > 2008/06/08 15:57:58| Too few store_rewriter processes are running > FATAL: The store_rewriter helpers are crashing too rapidly, need help! > > Squid Cache (Version 2.7.STABLE2-20080607): Terminated abnormally. > > > Adrian Chadd wrote: >> >> Hm, squid shouldn't eb crashing. stuff your config file and the crash >> output >> into a bugzilla ticket so it doesn't get lost. >> >> >> >> Adrian >> >> On Sun, Jun 08, 2008, pokeman wrote: >>> >>> hi Adrian >>> i am glad happy with this you make posible to cache CDN objects so i >>> make >>> changes in my conf but the squid was crash here is my conf i think i >>> forgotten some tag in my squid conf .and please add changes in below >>> store_url_rewrite script for windowsupdate caches and highlight what i >>> am >>> getting wrong >>> >>> squid.conf >>> ###3 >>> >>> http_port 3128 transparent >>> range_offset_limit 0 KB >>> cache_mem 512 MB >>> pipeline_prefetch on >>> shutdown_lifetime 2 seconds >>> coredump_dir /var/log/squid >>> ignore_unknown_nameservers on >>> >>> acl all src 0.0.0.0/0.0.0.0 >>> acl ourusers src 192.168.0.0/24 >>> hierarchy_stoplist cgi-bin ? >>> >>> storeurl_rewrite_program /extra/store_url_rewrite >>> >>> maximum_object_size 20 MB >>> minimum_object_size 0 KB >>> maximum_object_size_in_memory 64 KB >>> cache_replacement_policy heap LFUDA >>> memory_replacement_policy heap GDSF >>> >>> cache_dir aufs /cache1 7 16 256 >>> cache_dir aufs /cache2 7 16 256 >>> cache_dir aufs /cache3 7 16 256 >>> cache_dir aufs /cache4 7 16 256 >>> >>> cache_access_log /var/log/squid/access.log >>> cache_log /var/log/squid/cache.log >>> cache_store_log none >>> dns_nameservers 127.0.0.1 >>> refresh_pattern ^ftp: 144020% 10080 >>> refresh_pattern ^gopher:14400% 1440 >>> refresh_pattern -i (/cgi-bin/|\?) 0 0% 0 >>> refresh_pattern . 0 20% 4320 >>> >>> refresh_pattern cgi-bin 0 0% 0 >>> refresh_pattern \? 0 0% 0 >>> refresh_pattern . 0 20% 4320 >>> >>> negative_ttl 1 minutes >>> positive_dns_ttl 24 hours >>> negative_dns_ttl 1 minutes >>> acl manager proto cache_object >>> acl localhost src 127.0.0.1/255.255.255.255 >>> acl to_localhost dst 127.0.0.0/8 >>> acl store_rewrite_list dstdomain mt.google.com mt0.google.com >>> mt1.google.com >>> mt2.google.com >>> acl store_rewrite_list dstdomain mt3.google.com >>> acl store_rewrite_list dstdomain kh.google.com kh0.google.com >>> kh1.google.com >>> kh2.google.com >>> acl store_rewrite_list dstdomain kh3.google.com >>> acl store_rewrite_list dstdomain kh.google.com.au kh0.google.com.au >>> kh1.google.com.au >>> acl store_rewrite_list dstdomain kh2.google.com.au kh3.google.com.au >>> >>> # This needs to be narrowed down quite a bit! >>> acl store_rewrite_list dstdomain .youtube.com >>> acl store_rewrite_list dstdomain .windowsupdate.com >>> >>> >>> >>> acl windowsupdate dstdomain windowsupdate.microsoft.com >>> acl windowsupdate dstdomain .update.microsoft.com >>> acl windowsupdate d
Re: [squid-users] squid 2.7 with windowsupdate :(
do you found any error in my configuration Adrian Chadd wrote: > > Hm, squid shouldn't eb crashing. stuff your config file and the crash > output > into a bugzilla ticket so it doesn't get lost. > > > > Adrian > > On Sun, Jun 08, 2008, pokeman wrote: >> >> hi Adrian >> i am glad happy with this you make posible to cache CDN objects so i make >> changes in my conf but the squid was crash here is my conf i think i >> forgotten some tag in my squid conf .and please add changes in below >> store_url_rewrite script for windowsupdate caches and highlight what i am >> getting wrong >> >> squid.conf >> ###3 >> >> http_port 3128 transparent >> range_offset_limit 0 KB >> cache_mem 512 MB >> pipeline_prefetch on >> shutdown_lifetime 2 seconds >> coredump_dir /var/log/squid >> ignore_unknown_nameservers on >> >> acl all src 0.0.0.0/0.0.0.0 >> acl ourusers src 192.168.0.0/24 >> hierarchy_stoplist cgi-bin ? >> >> storeurl_rewrite_program /extra/store_url_rewrite >> >> maximum_object_size 20 MB >> minimum_object_size 0 KB >> maximum_object_size_in_memory 64 KB >> cache_replacement_policy heap LFUDA >> memory_replacement_policy heap GDSF >> >> cache_dir aufs /cache1 7 16 256 >> cache_dir aufs /cache2 7 16 256 >> cache_dir aufs /cache3 7 16 256 >> cache_dir aufs /cache4 7 16 256 >> >> cache_access_log /var/log/squid/access.log >> cache_log /var/log/squid/cache.log >> cache_store_log none >> dns_nameservers 127.0.0.1 >> refresh_pattern ^ftp: 144020% 10080 >> refresh_pattern ^gopher:14400% 1440 >> refresh_pattern -i (/cgi-bin/|\?) 0 0% 0 >> refresh_pattern . 0 20% 4320 >> >> refresh_pattern cgi-bin 0 0% 0 >> refresh_pattern \? 0 0% 0 >> refresh_pattern . 0 20% 4320 >> >> negative_ttl 1 minutes >> positive_dns_ttl 24 hours >> negative_dns_ttl 1 minutes >> acl manager proto cache_object >> acl localhost src 127.0.0.1/255.255.255.255 >> acl to_localhost dst 127.0.0.0/8 >> acl store_rewrite_list dstdomain mt.google.com mt0.google.com >> mt1.google.com >> mt2.google.com >> acl store_rewrite_list dstdomain mt3.google.com >> acl store_rewrite_list dstdomain kh.google.com kh0.google.com >> kh1.google.com >> kh2.google.com >> acl store_rewrite_list dstdomain kh3.google.com >> acl store_rewrite_list dstdomain kh.google.com.au kh0.google.com.au >> kh1.google.com.au >> acl store_rewrite_list dstdomain kh2.google.com.au kh3.google.com.au >> >> # This needs to be narrowed down quite a bit! >> acl store_rewrite_list dstdomain .youtube.com >> acl store_rewrite_list dstdomain .windowsupdate.com >> >> >> >> acl windowsupdate dstdomain windowsupdate.microsoft.com >> acl windowsupdate dstdomain .update.microsoft.com >> acl windowsupdate dstdomain download.windowsupdate.com >> acl windowsupdate dstdomain redir.metaservices.microsoft.com >> acl windowsupdate dstdomain images.metaservices.microsoft.com >> acl windowsupdate dstdomain c.microsoft.com >> acl windowsupdate dstdomain www.download.windowsupdate.com >> acl windowsupdate dstdomain wustat.windows.com >> acl windowsupdate dstdomain crl.microsoft.com >> acl CONNECT method CONNECT >> acl wuCONNECT dstdomain www.update.microsoft.com >> >> acl SSL_ports port 443 563 >> acl Safe_ports port 1195 1107 1174 1212 1000 >> acl Safe_ports port 80 # http >> acl Safe_ports port 82 # http >> acl Safe_ports port 81 # http >> acl Safe_ports port 21 # ftp >> acl Safe_ports port 443 563 # https, snews >> acl Safe_ports port 70 # gopher >> acl Safe_ports port 210 # wais >> acl Safe_ports port 1025-65535 # unregistered ports >> acl Safe_ports port 280 # http-mgmt >> acl Safe_ports port 488 # gss-http >> acl Safe_ports port 591 # filemaker >> acl Safe_ports port 777 # multiling http >> acl CONNECT method CONNECT >> >> http_access allow manager localhost >> http_access deny manager >> http_access deny !Safe_ports >> http_access deny CONNECT !SSL_ports >> http_access allow ourusers >> http_access allow CONNECT wuCONNECT ourusers >> http_access allow windowsupdate ourusers >> http_access deny all >> http_reply_access allow all >> cache allow
Re: [squid-users] Cacheboy-1.1 release, testers wanted!
hi dude i have senario we can test this our production env :) 12 MB BW Fedora 9 install with TOS Adrian Chadd wrote: > > Hi everyone, > > I've just released Cacheboy-1.1, which is essentially an almost current > snapshot of Squid-2.HEAD with a whole lot of code reorganisation and a > couple > of new minor features. > > It certainly seems stable enough in local testing and limited third party > testing. I'll see if I can get permission from those who are testing it to > drop names, but its seen some reasonably busy production loads and as I > said, it seems stable enough. > > I'd like to try and get this stuff tested more thoroughly in production > environments before I begin trying to roll these changes back into > Squid-2.HEAD. > > My work to date is mostly code reorganisation in preparation for larger > scale > changes. I've done about as much code shuffling as I can do in this first > pass > without beginning much more intrusive code changes to fix various silly > choices made in the past. I'd like this code to be tested out first as > widely > as possible before I begin my next set of slightly more intrusive changes. > > This should mostly be a drop-in replacement for those running Squid-2 > under > UNIX. I haven't yet done any compatibility work to fix it to compile > outside > of Linux, FreeBSD and Solaris 10. > > No, you probably won't notice any functionality or performance differences > between > Squid-2.7 and Cacheboy. Well, unless you're running Solaris - there's an > implementation of event ports for the network IO. ./configure --help has > some > more information about that. Performance and feature work will come (much) > later; > too much reorganisation needs to be done first to set the scene for said > changes. > > The 1.0 and 1.1 tarballs can be fetched from: > > http://code.google.com/p/cacheboy/downloads/ > > The wiki has some basic information about whats going on: > > http://code.google.com/p/cacheboy/wiki/ > > Finally, if you're at all interested in the "why" behind the "what", take > a look > at the blog: http://cacheboy.blogspot.com/ > > The wider the testing I get, the quicker this stuff can be made stable and > rolled > into the next Squid-2 release. > > Thanks! > > > > Adrian > > > -- > - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid > Support - > - $25/pm entry-level VPSes w/ capped bandwidth charges available in WA - > > -- View this message in context: http://www.nabble.com/Cacheboy-1.1-release%2C-testers-wanted%21-tp17710345p17716506.html Sent from the Squid - Users mailing list archive at Nabble.com.
[squid-users] squid 2.7 with windowsupdate :(
hi Adrian
i am glad happy with this you make posible to cache CDN objects so i make
changes in my conf but the squid was crash here is my conf i think i
forgotten some tag in my squid conf .and please add changes in below
store_url_rewrite script for windowsupdate caches and highlight what i am
getting wrong
squid.conf
###3
http_port 3128 transparent
range_offset_limit 0 KB
cache_mem 512 MB
pipeline_prefetch on
shutdown_lifetime 2 seconds
coredump_dir /var/log/squid
ignore_unknown_nameservers on
acl all src 0.0.0.0/0.0.0.0
acl ourusers src 192.168.0.0/24
hierarchy_stoplist cgi-bin ?
storeurl_rewrite_program /extra/store_url_rewrite
maximum_object_size 20 MB
minimum_object_size 0 KB
maximum_object_size_in_memory 64 KB
cache_replacement_policy heap LFUDA
memory_replacement_policy heap GDSF
cache_dir aufs /cache1 7 16 256
cache_dir aufs /cache2 7 16 256
cache_dir aufs /cache3 7 16 256
cache_dir aufs /cache4 7 16 256
cache_access_log /var/log/squid/access.log
cache_log /var/log/squid/cache.log
cache_store_log none
dns_nameservers 127.0.0.1
refresh_pattern ^ftp: 144020% 10080
refresh_pattern ^gopher:14400% 1440
refresh_pattern -i (/cgi-bin/|\?) 0 0% 0
refresh_pattern . 0 20% 4320
refresh_pattern cgi-bin 0 0% 0
refresh_pattern \? 0 0% 0
refresh_pattern . 0 20% 4320
negative_ttl 1 minutes
positive_dns_ttl 24 hours
negative_dns_ttl 1 minutes
acl manager proto cache_object
acl localhost src 127.0.0.1/255.255.255.255
acl to_localhost dst 127.0.0.0/8
acl store_rewrite_list dstdomain mt.google.com mt0.google.com mt1.google.com
mt2.google.com
acl store_rewrite_list dstdomain mt3.google.com
acl store_rewrite_list dstdomain kh.google.com kh0.google.com kh1.google.com
kh2.google.com
acl store_rewrite_list dstdomain kh3.google.com
acl store_rewrite_list dstdomain kh.google.com.au kh0.google.com.au
kh1.google.com.au
acl store_rewrite_list dstdomain kh2.google.com.au kh3.google.com.au
# This needs to be narrowed down quite a bit!
acl store_rewrite_list dstdomain .youtube.com
acl store_rewrite_list dstdomain .windowsupdate.com
acl windowsupdate dstdomain windowsupdate.microsoft.com
acl windowsupdate dstdomain .update.microsoft.com
acl windowsupdate dstdomain download.windowsupdate.com
acl windowsupdate dstdomain redir.metaservices.microsoft.com
acl windowsupdate dstdomain images.metaservices.microsoft.com
acl windowsupdate dstdomain c.microsoft.com
acl windowsupdate dstdomain www.download.windowsupdate.com
acl windowsupdate dstdomain wustat.windows.com
acl windowsupdate dstdomain crl.microsoft.com
acl CONNECT method CONNECT
acl wuCONNECT dstdomain www.update.microsoft.com
acl SSL_ports port 443 563
acl Safe_ports port 1195 1107 1174 1212 1000
acl Safe_ports port 80 # http
acl Safe_ports port 82 # http
acl Safe_ports port 81 # http
acl Safe_ports port 21 # ftp
acl Safe_ports port 443 563 # https, snews
acl Safe_ports port 70 # gopher
acl Safe_ports port 210 # wais
acl Safe_ports port 1025-65535 # unregistered ports
acl Safe_ports port 280 # http-mgmt
acl Safe_ports port 488 # gss-http
acl Safe_ports port 591 # filemaker
acl Safe_ports port 777 # multiling http
acl CONNECT method CONNECT
http_access allow manager localhost
http_access deny manager
http_access deny !Safe_ports
http_access deny CONNECT !SSL_ports
http_access allow ourusers
http_access allow CONNECT wuCONNECT ourusers
http_access allow windowsupdate ourusers
http_access deny all
http_reply_access allow all
cache allow all
storeurl_access allow store_rewrite_list
storeurl_access deny all
icp_access allow ourusers
icp_access deny all
cache_mgr info@
visible_hostname CE-
dns_testnames localhost
reload_into_ims on
quick_abort_min 0 KB
quick_abort_max 0 KB
log_fqdn off
half_closed_clients off
client_db off
ipcache_size 16384
ipcache_low 90
ipcache_high 95
fqdncache_size 8129
log_icp_queries off
strip_query_terms off
store_dir_select_algorithm round-robin
client_persistent_connections off
server_persistent_connections on
persistent_request_timeout 1 minute
client_lifetime 60 minutes
pconn_timeout 10 seconds
tcp_outgoing_tos 0x30 ourusers
zph_mode tos
zph_local 0x30
zph_parent 0
###
[EMAIL PROTECTED] ~]# cat /extra/store_url_rewrite
$| = 1;
while (<>) {
chomp;
# print STDERR $_ . "\n";
if (m/kh(.*?)\.google\.com(.*?)\/(.*?) /) {
print "http://keyhole-srv.google.com"; . $2 .
".SQUIDINTERNAL/" . $3 . "\n";
# print STDERR "KEYHOLE\n";
} elsif (m/mt(.*?)\.google\.com(.*?)\/(.*?) /) {
print "http://map-srv.google.com"; . $2 . ".SQUIDINTERNAL/" .
$3 . "\n";
# print STDERR "MAPSRV\n";
} elsif
(m/^http:\/\/([A-Za-z]*?)-(.*?)\.(.*)\.youtube\.com\/get_video\?video_id=(.*)
/) {
#
http://lax-
[squid-users] storeAufsOpenDone
i just turn my DiskD to aufs i received this error storeAufsOpenDone: (1) Operation not permitted 2008/02/18 21:55:29|/ncache8/00/01/01FD -- View this message in context: http://www.nabble.com/storeAufsOpenDone-tp15547037p15547037.html Sent from the Squid - Users mailing list archive at Nabble.com.
Re: AW: [squid-users] squid source compile
i use this tool to compile files can i use it to compile squid.conf developers need your suggestion http://www.datsi.fi.upm.es/~frosal Jörg Hoffmann wrote: > > It should be possible to change the default values in the source so no > squid.conf needs to be used. But anyone with access to the source or even > the compiled squid might see the default values. You can chmod the config > file to 500, so noone except the owner (root or the squid-user) can read > the > file. > When you specify what do you got for a system or server and who shouldn't > get access to the config we might could do better help > And i think there is nothing special in the config which noone shouldn't > see > > -Ursprüngliche Nachricht- > Von: pokeman [mailto:[EMAIL PROTECTED] > Gesendet: Freitag, 15. Februar 2008 15:21 > An: squid-users@squid-cache.org > Betreff: [squid-users] squid source compile > > > can i compile and hide the squid.conf nobody can view settings > > -- > View this message in context: > http://www.nabble.com/squid-source-compile-tp15502058p15502058.html > Sent from the Squid - Users mailing list archive at Nabble.com. > > > -- View this message in context: http://www.nabble.com/squid-source-compile-tp15502058p15515008.html Sent from the Squid - Users mailing list archive at Nabble.com.
[squid-users] squid source compile
can i compile and hide the squid.conf nobody can view settings -- View this message in context: http://www.nabble.com/squid-source-compile-tp15502058p15502058.html Sent from the Squid - Users mailing list archive at Nabble.com.
Re: [squid-users] TCP_HIT and TCP_MEM_HIT
TCP HIT is contain object in harddrive and TCP_MEM_HIT contain object in memory J. Peng wrote: > > what's the difference between TCP_HIT and TCP_MEM_HIT ? > > I found access.log has full of TCP_HIT but few TCP_MEM_HIT, is it right? > > thanks! > > -- View this message in context: http://www.nabble.com/TCP_HIT-and-TCP_MEM_HIT-tp15498612p15499973.html Sent from the Squid - Users mailing list archive at Nabble.com.
Re: [squid-users] squid-2.7 and youtube caching
can i use in production and its works with caching windowsupdate ? Adrian Chadd wrote: > > On Wed, Feb 13, 2008, pokeman wrote: >> >> 2.7 where is download Link :) > > www.squid-cache.org/Versions/v2/2.7/ > > > > adrian > > > -- View this message in context: http://www.nabble.com/squid-2.7-and-youtube-caching-tp14979279p15495590.html Sent from the Squid - Users mailing list archive at Nabble.com.
Re: [squid-users] Mem Cache flush
i seen today a lots of cache hit results i setup my cache drivers 7000 mb now the limit is full what now happen if another object want to be cache how to squid expire not use objects and old objects i am not set any low high water mark i already post my conf also i am using ZPH here is my squid HIT info Squid Object Cache: Version 2.6.STABLE18 Start Time: Tue, 12 Feb 2008 16:56:17 GMT Current Time: Wed, 13 Feb 2008 19:46:18 GMT Connection information for squid: Number of clients accessing cache: 0 Number of HTTP requests received: 10290978 Number of ICP messages received:0 Number of ICP messages sent:0 Number of queued ICP replies: 0 Request failure ratio: 0.00 Average HTTP requests per minute since start: 6391.9 Average ICP messages per minute since start:0.0 Select loop called: 82844943 times, 1.166 ms avg Cache information for squid: Request Hit Ratios: 5min: 44.6%, 60min: 45.0% Byte Hit Ratios:5min: 19.8%, 60min: 23.5% Request Memory Hit Ratios: 5min: 32.9%, 60min: 31.9% Request Disk Hit Ratios:5min: 31.6%, 60min: 34.3% Storage Swap size: 45131052 KB Storage Mem size: 524224 KB Mean Object Size: 21.58 KB Requests given to unlinkd: 339 Median Service Times (seconds) 5 min60 min: HTTP Requests (All): 0.24524 0.25890 Cache Misses: 0.44492 0.46965 Cache Hits:0.00286 0.00379 Near Hits: 0.24524 0.25890 Not-Modified Replies: 0.00091 0.00091 DNS Lookups: 0.00464 0.00372 ICP Queries: 0.0 0.0 Resource usage for squid: UP Time:96600.326 seconds CPU Time: 21118.258 seconds CPU Usage: 21.86% CPU Usage, 5 minute avg:35.46% CPU Usage, 60 minute avg: 37.29% Process Data Segment Size via sbrk(): 914716 KB Maximum Resident Size: 0 KB Page faults with physical i/o: 0 Memory usage for squid via mallinfo(): Total space in arena: 914716 KB Ordinary blocks: 900701 KB 856201 blks Small blocks: 0 KB 0 blks Holding blocks: 20680 KB 13 blks Free Small blocks: 0 KB Free Ordinary blocks: 14014 KB Total in use: 921381 KB 99% Total free: 14014 KB 1% Total size:935396 KB Memory accounted for: Total accounted: 763842 KB memPoolAlloc calls: 1198206486 memPoolFree calls: 1191587209 File descriptor usage for squid: Maximum number of file descriptors: 32768 Largest file desc currently in use: 1554 Number of file desc currently in use: 1342 Files queued for open: 0 Available number of file descriptors: 31426 Reserved number of file descriptors: 100 Store Disk files open: 0 IO loop method: epoll Internal Data Structures: 2116617 StoreEntries 111018 StoreEntries with MemObjects 110528 Hot Object Cache Items 2091341 on-disk objects Adrian Chadd wrote: > > On Wed, Feb 13, 2008, pokeman wrote: >> >> thanks i just switch my cache drives to aufs can you explane me in detail >> what other changes i made in my squid.conf for high cache resuls we have >> almost 45 mb link for proxy services 30 mb. can i add more harddrive to >> caching or just tweak to my squid and linux kernal. ! remember we are >> using >> RHEL ES 4 . i know bsd given high availablity but we can'nt use > > You can just convert diskd to aufs, yes, as long as its compiled in. > It just requires a restart to be safe. > > You then need to grab some logfile statistics stuff from the internet > and see what content is being cached and what isn't being cached. > Then you can decide what to look to cache. :) > > > > ADrian > >> >> Adrian Chadd wrote: >> > >> > G'day, >> > >> > A few notes. >> > >> > * Diskd isn't stable, and won't be until I commit my next set of >> patches >> > to 2.7 and 3.0; use aufs for now. >> > >> > * Caching windows updates will be possible in Squid-2.7. It'll require >> > some >> > rules and a custom rewrite helper. >> > >> > * 3.0 isn't yet as fast as 2.6 or 2.7. >> > >> > >> > Adrian >> > >> > On Tue, Feb 12, 2008, pokeman wrote: >> >> >> >> Well I experience with squid cache not good works on heavy load I 4 >> core >> >&
Re: [squid-users] bittorrent behind squid
MAN you need to set up some firewall rules to run torrents i thinks torrents not fully support http connections they use alternate Arun Shrimali wrote: > > Dear All, > > I am having client (fedora 8) behind the squid proxy (with > authentication). I am trying to download the files through bittorrent > (Transmission) client at fedora client PC. > Can anybody help me how to configure client (or squid at server) to > download the files. > > regards > > Arun > > -- View this message in context: http://www.nabble.com/bittorrent-behind-squid-tp15450228p15462439.html Sent from the Squid - Users mailing list archive at Nabble.com.
Re: [squid-users] About my squid.conf
well there is many options 1. you are set maximum_object_size 100 MB and your cache drive define only 1024 its around 1 gb i experience with squid i don't think so if any user download file larger then 32 mb and same file download another user thats was waste of your cache drive if you are really need this so upgrage your drive upto 10 GB 2. switch your cache drive UFS to AUFS 3. use refresh patten as per your frequently use pages grep from your logs Anderson dos Santos Donda wrote: > > Here in my simple server, the squid works fine, but after post a > message about radio, Amos sad: > > " Squid is actually an > interceptor, not fully transparent. When they go down clients can expect > 'Unable to Connect' errors. " > > And, this is true. When my squid go down, my clients can't be surf > because squid is not working. > > I don't have anotherr server, and I don't need too. > > I need only control the navegation of my clients on the internet. > > So, if possible, I want if anyone can see my squid.conf and tell me if > it is good or need improvement. > > Thanks for all. > > My squid.conf: > > http_port 10.0.0.250:3128 transparent > > icp_port 0 > > cache_mem 128 MB > cache_swap_low 90 > cache_swap_high 95 > cache_dir ufs /usr/local/squid/var/cache 1024 16 256 > cache_access_log /usr/local/squid/var/logs/access.log > cache_log /usr/local/squid/var/logs/cache.log > cache_store_log none > maximum_object_size_in_memory 1 MB > maximum_object_size 100 MB > minimum_object_size 0 MB > > pid_filename /usr/local/squid/var/logs/squid.pid > > visible_hostname squid.provider.com.br > > cache_effective_user squidaemon > cache_effective_group squid > > acl autologinDSA dst 10.0.0.250/32 > > acl diretor src 10.0.0.55/32 > acl recepcao src 10.0.0.57/32 > acl financeiro src 10.0.0.56/32 > acl suporte src 10.0.0.248/32 > acl suporte2 src 10.0.0.13/32 > > acl vip1 src 10.0.1.0/28 > acl vip2 src 10.0.2.0/28 > acl vip3 src 10.0.3.0/28 > acl vip4 src 10.0.4.0/28 > > acl forbidden_words url_regex -i "/usr/local/squid/etc/forbidden_words" > acl forbidden_down url_regex -i "/usr/local/squid/etc/forbidden_down" > > external_acl_type checkip children=40 % SRC > /usr/local/mwsystem/squid/sbin/checkv2.sh > > acl checkblock external checkip > > acl all src 0.0.0.0/0.0.0.0 > acl localnet src 10.0.0.0/16 > acl localhost src 127.0.0.0/32 > acl method_control proto cache_object > > http_access allow method_control localhost > http_access deny method_control > > http_access allow autologinDSa > > http_access deny checkblock !autologinDSA > > http_access allow diretor > http_access allow diretor forbidden_down > > http_access allow recepcao autologinDSA > http_access allow recepcao > > http_access deny financeiro > > http_access allow suporte > http_access allow suporte2 > > http_access deny forbidden_words > http_access deny forbidden_down > > http_access allow vip1 > http_access allow vip2 > http_access allow vip3 > http_access allow vip4 > > http_access deny localnet !autologinDSA > http_access deny all > http_access deny localnet > > -- View this message in context: http://www.nabble.com/About-my-squid.conf-tp15458475p15462290.html Sent from the Squid - Users mailing list archive at Nabble.com.
Re: [squid-users] squid-2.7 and youtube caching
2.7 where is download Link :) Adrian Chadd wrote: > > G'day everyone, > > For those of you who would like to try caching youtube content (as best it > can be cached right now), please install the squid-2.7 snapshot, make > sure its working, and then head over to the Wiki. > > http://wiki.squid-cache.org/Features/StoreUrlRewrite/RewriteScript > > Now, this (and other!) stuff may not be properly cached yet if you're > running > Squid in a transparent proxy mode. I'm looking into that particular issue. > But it certainly works for normal explicitly configured caches. > > Let me know how it goes! > > > > > Adrian > > -- > - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid > Support - > - $25/pm entry-level VPSes w/ capped bandwidth charges available in WA - > > -- View this message in context: http://www.nabble.com/squid-2.7-and-youtube-caching-tp14979279p15458802.html Sent from the Squid - Users mailing list archive at Nabble.com.
Re: [squid-users] Mem Cache flush
thanks i just switch my cache drives to aufs can you explane me in detail what other changes i made in my squid.conf for high cache resuls we have almost 45 mb link for proxy services 30 mb. can i add more harddrive to caching or just tweak to my squid and linux kernal. ! remember we are using RHEL ES 4 . i know bsd given high availablity but we can'nt use Adrian Chadd wrote: > > G'day, > > A few notes. > > * Diskd isn't stable, and won't be until I commit my next set of patches > to 2.7 and 3.0; use aufs for now. > > * Caching windows updates will be possible in Squid-2.7. It'll require > some > rules and a custom rewrite helper. > > * 3.0 isn't yet as fast as 2.6 or 2.7. > > > Adrian > > On Tue, Feb 12, 2008, pokeman wrote: >> >> Well I experience with squid cache not good works on heavy load I 4 core >> processor machine with 7 scsi drives 4 gb ram average work load in peak >> hours 3000 users 30 mb bandwidth on that machine using RHEL ES 4. I >> search >> many articles on high cache performance specially windows update these >> days >> very headache to save PSF extension i heard In squid release 3.0 for >> better >> performance but why squid developers could???nt find solution for cache >> windows update in 2.6 please suggest me if I am doing something wrong in >> my >> squid.conf >> >> >> http_port 3128 transparent >> range_offset_limit 0 KB >> cache_mem 512 MB >> pipeline_prefetch on >> shutdown_lifetime 2 seconds >> coredump_dir /var/log/squid >> ignore_unknown_nameservers on >> acl all src 0.0.0.0/0.0.0.0 >> acl ourusers src 192.168.100.0/24 >> hierarchy_stoplist cgi-bin ? >> maximum_object_size 16 MB >> minimum_object_size 0 KB >> maximum_object_size_in_memory 64 KB >> cache_replacement_policy heap LFUDA >> memory_replacement_policy heap GDSF >> cache_dir diskd /cache1 7000 16 256 >> cache_dir diskd /cache2 7000 16 256 >> cache_dir diskd /cache3 7000 16 256 >> cache_dir diskd /cache4 7000 16 256 >> cache_dir diskd /cache5 7000 16 256 >> cache_dir diskd /cache6 7000 16 256 >> cache_dir diskd /cache7 7000 16 256 >> cache_access_log none >> cache_log /var/log/squid/cache.log >> cache_store_log none >> dns_nameservers 127.0.0.1 >> refresh_pattern windowsupdate.com/.*\.(cab|exe|dll) 43200100% >> 43200 >> refresh_pattern download.microsoft.com/.*\.(cab|exe|dll) 43200 100% >> 43200 >> refresh_pattern au.download.windowsupdate.com/.*\.(cab|exe|psf) 43200 >> 100% >> 43200 >> refresh_pattern^ftp: 1440 20% 10080 >> refresh_pattern^gopher:1440 0% 1440 >> refresh_patterncgi-bin 0 0% 0 >> refresh_pattern\? 0 0% 4320 >> refresh_pattern. 0 20% 4320 >> negative_ttl 1 minutes >> positive_dns_ttl 24 hours >> negative_dns_ttl 1 minutes >> acl manager proto cache_object >> acl localhost src 127.0.0.1/255.255.255.255 >> acl to_localhost dst 127.0.0.0/8 >> acl SSL_ports port 443 563 >> acl Safe_ports port 1195 1107 1174 1212 1000 >> acl Safe_ports port 80 # http >> acl Safe_ports port 82 # http >> acl Safe_ports port 81 # http >> acl Safe_ports port 21 # ftp >> acl Safe_ports port 443 563 # https, snews >> acl Safe_ports port 70 # gopher >> acl Safe_ports port 210 # wais >> acl Safe_ports port 1025-65535 # unregistered ports >> acl Safe_ports port 280 # http-mgmt >> acl Safe_ports port 488 # gss-http >> acl Safe_ports port 591 # filemaker >> acl Safe_ports port 777 # multiling http >> acl CONNECT method CONNECT >> http_access allow manager localhost >> http_access deny manager >> http_access deny !Safe_ports >> http_access deny CONNECT !SSL_ports >> http_access allow ourusers >> http_access deny all >> http_reply_access allow all >> cache allow all >> icp_access allow ourusers >> icp_access deny all >> cache_mgr [EMAIL PROTECTED] >> visible_hostname CE-Fariya >> dns_testnames localhost >> reload_into_ims on >> quick_abort_min 0 KB >> quick_abort_max 0 KB >> log_fqdn off >> half_closed_clients off >> client_db off >> ipcache_size 16384 >> ipcache_low 90 >> ipcache_high 95 >> fqdncache_size 8129 >> log_icp_queries off >> strip_query_terms off >> store_dir_select_algorithm round-robin >> client_persistent_connections off >> server_persistent_conne
Re: [squid-users] Mem Cache flush
Well I experience with squid cache not good works on heavy load I 4 core processor machine with 7 scsi drives 4 gb ram average work load in peak hours 3000 users 30 mb bandwidth on that machine using RHEL ES 4. I search many articles on high cache performance specially windows update these days very headache to save PSF extension i heard In squid release 3.0 for better performance but why squid developers could’nt find solution for cache windows update in 2.6 please suggest me if I am doing something wrong in my squid.conf http_port 3128 transparent range_offset_limit 0 KB cache_mem 512 MB pipeline_prefetch on shutdown_lifetime 2 seconds coredump_dir /var/log/squid ignore_unknown_nameservers on acl all src 0.0.0.0/0.0.0.0 acl ourusers src 192.168.100.0/24 hierarchy_stoplist cgi-bin ? maximum_object_size 16 MB minimum_object_size 0 KB maximum_object_size_in_memory 64 KB cache_replacement_policy heap LFUDA memory_replacement_policy heap GDSF cache_dir diskd /cache1 7000 16 256 cache_dir diskd /cache2 7000 16 256 cache_dir diskd /cache3 7000 16 256 cache_dir diskd /cache4 7000 16 256 cache_dir diskd /cache5 7000 16 256 cache_dir diskd /cache6 7000 16 256 cache_dir diskd /cache7 7000 16 256 cache_access_log none cache_log /var/log/squid/cache.log cache_store_log none dns_nameservers 127.0.0.1 refresh_pattern windowsupdate.com/.*\.(cab|exe|dll) 43200100% 43200 refresh_pattern download.microsoft.com/.*\.(cab|exe|dll) 43200 100% 43200 refresh_pattern au.download.windowsupdate.com/.*\.(cab|exe|psf) 43200 100% 43200 refresh_pattern^ftp: 1440 20% 10080 refresh_pattern^gopher:1440 0% 1440 refresh_patterncgi-bin 0 0% 0 refresh_pattern\? 0 0% 4320 refresh_pattern. 0 20% 4320 negative_ttl 1 minutes positive_dns_ttl 24 hours negative_dns_ttl 1 minutes acl manager proto cache_object acl localhost src 127.0.0.1/255.255.255.255 acl to_localhost dst 127.0.0.0/8 acl SSL_ports port 443 563 acl Safe_ports port 1195 1107 1174 1212 1000 acl Safe_ports port 80 # http acl Safe_ports port 82 # http acl Safe_ports port 81 # http acl Safe_ports port 21 # ftp acl Safe_ports port 443 563 # https, snews acl Safe_ports port 70 # gopher acl Safe_ports port 210 # wais acl Safe_ports port 1025-65535 # unregistered ports acl Safe_ports port 280 # http-mgmt acl Safe_ports port 488 # gss-http acl Safe_ports port 591 # filemaker acl Safe_ports port 777 # multiling http acl CONNECT method CONNECT http_access allow manager localhost http_access deny manager http_access deny !Safe_ports http_access deny CONNECT !SSL_ports http_access allow ourusers http_access deny all http_reply_access allow all cache allow all icp_access allow ourusers icp_access deny all cache_mgr [EMAIL PROTECTED] visible_hostname CE-Fariya dns_testnames localhost reload_into_ims on quick_abort_min 0 KB quick_abort_max 0 KB log_fqdn off half_closed_clients off client_db off ipcache_size 16384 ipcache_low 90 ipcache_high 95 fqdncache_size 8129 log_icp_queries off strip_query_terms off store_dir_select_algorithm round-robin client_persistent_connections off server_persistent_connections on persistent_request_timeout 1 minute client_lifetime 60 minutes pconn_timeout 10 seconds Adrian Chadd wrote: > > On Thu, Jan 31, 2008, Chris Woodfield wrote: >> Interesting. What sort of size threshold do you see where performance >> begins to drop off? Is it just a matter of larger objects reducing >> hitrate (due to few objects being cacheable in memory) or a bottleneck >> in squid itself that causes issues? > > Its a bottleneck in the Squid code which makes accessing the n'th 4k > chunk in memory take O(N) time. > > Its one of the things I'd like to fix after Squid-2.7 is released. > > > > Adrian > > > -- View this message in context: http://www.nabble.com/Mem-Cache-flush-tp14951540p15449954.html Sent from the Squid - Users mailing list archive at Nabble.com.
