Re: [squid-users] cached MS updates !

2008-12-21 Thread Oleg Motienko 
On Tue, Jun 17, 2008 at 1:24 AM, Henrik Nordstrom
hen...@henriknordstrom.net wrote:
 On mån, 2008-06-16 at 08:16 -0700, pokeman wrote:
 thanks henrik for you reply
 any other way to save bandwidth windows updates almost use 30% of my entire
 bandwidth

 Microsoft has a update server you can run locally. But you need to have
 some control over the clients to make them use this instead of windows
 update...

 Or you could look into sponsoring some Squid developer to add caching of
 partial objects with the goal of allowing http access to windows update
 to be cached. (the versions using https can not be done much about...)

I made such caching by removing headers Range from requests
(transparent redirect to nginx webserver in proxy mode before squid).
Works fine for my  ~ 1500 users. Cache size is 4G for now and growing.
Additionally It's possible to make static cache (I made it on the same
nginx, via proxy_store), so big files like servicepacks will be stored
in filesystem. Also it's possible to put in filesystem already
downloaded servicepacks and fixes, this will save the bandwidth.

Squid is running transparent port on http://127.0.0.1:1 .
Http requests from LAN to windowupdate networks are redirected to 127.0.0.4:80

Nginx caches cab exe psf and cuts off Range header, other requests
redirected to MS sites;

Here is nginx config for caching site:

server {
listen127.0.0.4:80;
server_name  au.download.windowsupdate.com
www.au.download.windowsupdate.com;

access_log
/var/log/nginx/access-au.download.windowsupdate.com-cache.log  main;


# root url - don't cache here

location /  {
proxy_passhttp://127.0.0.1:1;
proxy_set_header   Host $host;
}


# ? urls - don't cache here
location ~* \?  {
proxy_passhttp://127.0.0.1:1;
proxy_set_header   Host $host;
}


# here is static caching

location ~* ^/msdownload.+\.(cab|exe|psf)$ {
root /.1/msupd/au.download.windowsupdate.com;
error_page   404 = @fetch;
}


location @fetch {
internal;

proxy_passhttp://127.0.0.1:1;
proxy_set_header   Range'';
proxy_set_header   Host $host;

proxy_store  on;
proxy_store_access   user:rw  group:rw  all:rw;
proxy_temp_path  /.1/msupd/au.download.windowsupdate.com/temp;

root /.1/msupd/au.download.windowsupdate.com;
}

# error messages (if got err from squid)

error_page   500 502 503 504  /50x.html;
location = /50x.html {
root   html;
}


}

Re: [squid-users] cached MS updates !

2008-12-21 Thread Philipp Rusch - New Vision IT 

Richard Neville schrieb:
Hi Phillip, the issue is: I run a computer repair business, the pcs 
that are comming in needed updates have various network 
configurations, as far as I'm aware, WSUS is good if you have existing 
set PC list that you configure to look at your server for updates, as 
I'm always getting different systems, I thought a fully transparent 
system would be best


Thanks for the email!

Happy christmas!  


Sent from my iPhone

On 21/12/2008, at 10:42 PM, Philipp Rusch - New Vision IT 
philipp.ru...@newvision-it.de mailto:philipp.ru...@newvision-it.de 
wrote:



Richard Neville schrieb:

Henrik Nordstrom henrik at henriknordstrom.net writes:

  

On mån, 2008-06-16 at 08:16 -0700, pokeman wrote:

thanks henrik for you reply 
any other way to save bandwidth windows updates almost use 30% of my entire
bandwidth 
  

Microsoft has a update server you can run locally. But you need to have
some control over the clients to make them use this instead of windows
update...

Or you could look into sponsoring some Squid developer to add caching of
partial objects with the goal of allowing http access to windows update
to be cached. (the versions using https can not be done much about...)

Regards
Henrik



Hi, Just thought id let you know, I currently am using an IPCop Firewall,
and one of the plugins (the reason i went with IPCOP) is an 
update accelerator plugin, that stores Windows, Apple, Symmantec, Avast and

linux updates on the
firewalls drive..

I actually found this site because i was trying to get help, and the developer
of the plugin seems cranky at the best of times.

Basically the system works, updates that a PC doesnt have gets loaded from the
firewall rather then the internet, but the updates themselves, it seems that MS
use multiple servers to store each update, now when I update a SP2 XP pro
system, it sees SP3, it downloaded a 850meg file, thats fine, it must be
multilanguage versions that its downloading..

the problem is that i update another SP2 system and it starts downloading the

850 megs again as its got the same file name, but comming from a different
 server.

would anyone here know how to rectify this?

im a 100% noob at linux but i have managed to get it up and running without too
much issue.

here's the plugin website for those interested.

http://update-accelerator.advproxy.net/

any help would be appreciated :)
planetx...@gmail.com mailto:planetx...@gmail.com

Why don't use the way Hendrik already recommended ?
I'd use Microsoft WSUS, its free and easy to setup.
And it will manage all these issues you have automagically.

HTH, Philipp

Richard, ok - I see and I understand your point of view.
But still, I would suggest something like the c't offline updater then:
http://www.heise.de/software/download/ct_offline_update/38170
(there is also an english version of this around ...)

This is far less complicated than Olegs solution and saves a lot of 
bandwidth

while being perfetctly suited for your various systems needs.
You just start the script and it does the rest from a local cache.

Happy christmas to you , too!

HTH, Philipp from Germany

Re: [squid-users] cached MS updates !

2008-12-21 Thread Adrian Chadd 
The one thing I've been looking to do for other updates is to
post-process store.log and find URLs which have been partial-replied
to (206) ending in various extensions, then queuing entire file
fetches of them to make sure they fully enter the cache.

Its suboptimal but it seems to work just fine.



adrian

2008/12/21 Oleg Motienko motie...@gmail.com:
 On Tue, Jun 17, 2008 at 1:24 AM, Henrik Nordstrom
 hen...@henriknordstrom.net wrote:
 On mån, 2008-06-16 at 08:16 -0700, pokeman wrote:
 thanks henrik for you reply
 any other way to save bandwidth windows updates almost use 30% of my entire
 bandwidth

 Microsoft has a update server you can run locally. But you need to have
 some control over the clients to make them use this instead of windows
 update...

 Or you could look into sponsoring some Squid developer to add caching of
 partial objects with the goal of allowing http access to windows update
 to be cached. (the versions using https can not be done much about...)

 I made such caching by removing headers Range from requests
 (transparent redirect to nginx webserver in proxy mode before squid).
 Works fine for my  ~ 1500 users. Cache size is 4G for now and growing.
 Additionally It's possible to make static cache (I made it on the same
 nginx, via proxy_store), so big files like servicepacks will be stored
 in filesystem. Also it's possible to put in filesystem already
 downloaded servicepacks and fixes, this will save the bandwidth.

 Squid is running transparent port on http://127.0.0.1:1 .
 Http requests from LAN to windowupdate networks are redirected to 127.0.0.4:80

 Nginx caches cab exe psf and cuts off Range header, other requests
 redirected to MS sites;

 Here is nginx config for caching site:

server {
listen127.0.0.4:80;
server_name  au.download.windowsupdate.com
 www.au.download.windowsupdate.com;

access_log
 /var/log/nginx/access-au.download.windowsupdate.com-cache.log  main;


 # root url - don't cache here

location /  {
proxy_passhttp://127.0.0.1:1;
proxy_set_header   Host $host;
}


 # ? urls - don't cache here
location ~* \?  {
proxy_passhttp://127.0.0.1:1;
proxy_set_header   Host $host;
}


 # here is static caching

location ~* ^/msdownload.+\.(cab|exe|psf)$ {
root /.1/msupd/au.download.windowsupdate.com;
error_page   404 = @fetch;
}


location @fetch {
internal;

proxy_passhttp://127.0.0.1:1;
proxy_set_header   Range'';
proxy_set_header   Host $host;

proxy_store  on;
proxy_store_access   user:rw  group:rw  all:rw;
proxy_temp_path  /.1/msupd/au.download.windowsupdate.com/temp;

root /.1/msupd/au.download.windowsupdate.com;
}

 # error messages (if got err from squid)

error_page   500 502 503 504  /50x.html;
location = /50x.html {
root   html;
}


}

Re: [squid-users] cached MS updates !

2008-06-16 Thread pokeman 

thanks henrik for you reply 
any other way to save bandwidth windows updates almost use 30% of my entire
bandwidth 


Henrik Nordstrom-5 wrote:
 
 On sön, 2008-06-15 at 06:40 -0700, pokeman wrote:
 no one explane this :(((
 
 Didn't understand there was a question.
 
 What is the question?
 
  1213248111.272979 192.168.0.5 TCP_MISS/206 44097 GET
 
 http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
  - DIRECT/8.12.137.30 multipart/byteranges
 
 I guess you ask whi this isn't cached, it's because it's a partial
 request, only requesting parts of the object, and Squid can not yet
 cache partial objects.
 
 Regards
 Henrik
 
  
 

-- 
View this message in context: 
http://www.nabble.com/cached-MS-updates-%21-tp17792708p17866715.html
Sent from the Squid - Users mailing list archive at Nabble.com.

Re: [squid-users] cached MS updates !

2008-06-16 Thread Rogelio Sevilla Fernandez 

im getting this on squdi 2.7stable2:

2008/06/16 12:15:45| storeClientReadHeader: no URL!
2008/06/16 12:15:45| storeClientReadHeader: no URL!
2008/06/16 12:15:45| storeClientReadHeader: no URL!
2008/06/16 12:15:45| storeClientReadHeader: no URL!
2008/06/16 12:15:46| storeClientReadHeader: no URL!


my squid.conf


refresh_pattern windowsupdate.com/.*\.(cab|exe|CAB|EXE|dll) 10080 90%  
99 ignore-no-cache override-expire ignore-private
refresh_pattern download.microsoft.com/.*\.(cab|CAB|EXE|exe|dll) 10080  
90% 99 ignore-no-cache override-expire ignore-private
refresh_pattern  
au.download.windowsupdate.com/.*\.(cab|exe|CAB|EXE|psf) 10080 90%  
99 ignore-no-cache override-expire ignore-private




acl store_rewrite_list url_regex ^http://(.*?)/windowsupdate\?
cache allow store_rewrite_list
storeurl_access allow store_rewrite_list
storeurl_access deny  all
storeurl_rewrite_program /usr/local/squid/bin/store_url_rewrite


My store_url_rewrite
#!/usr/bin/perl
$|=1;
while () {
  @X = split;
  $url = $X[0];
  $url =~  
[EMAIL PROTECTED]://(.*?)/update\?(.*)video_id=(.*?)[EMAIL PROTECTED]://au.download.windowsupdate.com.INTERNAL/ID=$3@;
  $url =~  
[EMAIL PROTECTED]://(.*?)/update\?(.*)video_id=(.*?)[EMAIL PROTECTED]://au.download.windowsupdate.com.INTERNAL/ID=$3@;

  print $url\n;
}



pokeman [EMAIL PROTECTED] ha escrito:



thanks henrik for you reply
any other way to save bandwidth windows updates almost use 30% of my entire
bandwidth


Henrik Nordstrom-5 wrote:


On sön, 2008-06-15 at 06:40 -0700, pokeman wrote:

no one explane this :(((


Didn't understand there was a question.

What is the question?


 1213248111.272979 192.168.0.5 TCP_MISS/206 44097 GET

http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
 - DIRECT/8.12.137.30 multipart/byteranges


I guess you ask whi this isn't cached, it's because it's a partial
request, only requesting parts of the object, and Squid can not yet
cache partial objects.

Regards
Henrik





--
View this message in context:   
http://www.nabble.com/cached-MS-updates-%21-tp17792708p17866715.html

Sent from the Squid - Users mailing list archive at Nabble.com.






--
Ing. Rogelio C. Sevilla Fernandez
Direccion de Desarrollo Telematico / Secretaria de Administracion
Gobierno del Estado de Colima
Tel (312)3162062 / (312)3162000 ext 2360

Re: [squid-users] cached MS updates !

2008-06-16 Thread Adrian Chadd 
Log a bug! I'll try to poke them all after exams. I haven't yet
sat down and properly made windows updates caching work so it'll
be good to get all of these bugs and scripts into bugzilla.



Adrian


On Mon, Jun 16, 2008, Rogelio Sevilla Fernandez wrote:
 im getting this on squdi 2.7stable2:
 
 2008/06/16 12:15:45| storeClientReadHeader: no URL!
 2008/06/16 12:15:45| storeClientReadHeader: no URL!
 2008/06/16 12:15:45| storeClientReadHeader: no URL!
 2008/06/16 12:15:45| storeClientReadHeader: no URL!
 2008/06/16 12:15:46| storeClientReadHeader: no URL!
 
 
 my squid.conf
 
 
 refresh_pattern windowsupdate.com/.*\.(cab|exe|CAB|EXE|dll) 10080 90%  
 99 ignore-no-cache override-expire ignore-private
 refresh_pattern download.microsoft.com/.*\.(cab|CAB|EXE|exe|dll) 10080  
 90% 99 ignore-no-cache override-expire ignore-private
 refresh_pattern  
 au.download.windowsupdate.com/.*\.(cab|exe|CAB|EXE|psf) 10080 90%  
 99 ignore-no-cache override-expire ignore-private
 
 
 
 acl store_rewrite_list url_regex ^http://(.*?)/windowsupdate\?
 cache allow store_rewrite_list
 storeurl_access allow store_rewrite_list
 storeurl_access deny  all
 storeurl_rewrite_program /usr/local/squid/bin/store_url_rewrite
 
 
 My store_url_rewrite
 #!/usr/bin/perl
 $|=1;
 while () {
   @X = split;
   $url = $X[0];
   $url =~  
 [EMAIL PROTECTED]://(.*?)/update\?(.*)video_id=(.*?)[EMAIL 
 PROTECTED]://au.download.windowsupdate.com.INTERNAL/ID=$3@;
   $url =~  
 [EMAIL PROTECTED]://(.*?)/update\?(.*)video_id=(.*?)[EMAIL 
 PROTECTED]://au.download.windowsupdate.com.INTERNAL/ID=$3@;
   print $url\n;
 }
 
 
 
 pokeman [EMAIL PROTECTED] ha escrito:
 
 
 thanks henrik for you reply
 any other way to save bandwidth windows updates almost use 30% of my entire
 bandwidth
 
 
 Henrik Nordstrom-5 wrote:
 
 On s?n, 2008-06-15 at 06:40 -0700, pokeman wrote:
 no one explane this :(((
 
 Didn't understand there was a question.
 
 What is the question?
 
  1213248111.272979 192.168.0.5 TCP_MISS/206 44097 GET
 
 http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
  - DIRECT/8.12.137.30 multipart/byteranges
 
 I guess you ask whi this isn't cached, it's because it's a partial
 request, only requesting parts of the object, and Squid can not yet
 cache partial objects.
 
 Regards
 Henrik
 
 
 
 
 --
 View this message in context:   
 http://www.nabble.com/cached-MS-updates-%21-tp17792708p17866715.html
 Sent from the Squid - Users mailing list archive at Nabble.com.
 
 
 
 
 
 -- 
 Ing. Rogelio C. Sevilla Fernandez
 Direccion de Desarrollo Telematico / Secretaria de Administracion
 Gobierno del Estado de Colima
 Tel (312)3162062 / (312)3162000 ext 2360

-- 
- Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support -
- $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -

Re: [squid-users] cached MS updates !

2008-06-16 Thread Henrik Nordstrom 
On mån, 2008-06-16 at 08:16 -0700, pokeman wrote:
 thanks henrik for you reply 
 any other way to save bandwidth windows updates almost use 30% of my entire
 bandwidth 

Microsoft has a update server you can run locally. But you need to have
some control over the clients to make them use this instead of windows
update...

Or you could look into sponsoring some Squid developer to add caching of
partial objects with the goal of allowing http access to windows update
to be cached. (the versions using https can not be done much about...)

Regards
Henrik


signature.asc
Description: This is a digitally signed message part

Re: [squid-users] cached MS updates !

2008-06-15 Thread pokeman 

no one explane this :(((




pokeman wrote:
 
 hi there 
 Refrence to following atricle 
 http://www.nabble.com/Re%3A-YouTube-and-other-streaming-media-%28caching%29-p17738020.html
 i am going to cached windowsupdate object here is changes in store script
 in squid.conf and output log 
 
 Squid.conf
 acl store_rewrite_list url_regex ^http://(.*?)/windowsupdate\?
 
 refresh_pattern windowsupdate.com/.*\.(cab|exe|dll) 10080 90% 99
 ignore-no-cache override-expire ignore-private
 refresh_pattern download.microsoft.com/.*\.(cab|exe|dll) 10080 90% 99
 ignore-no-cache override-expire ignore-private
 refresh_pattern au.download.windowsupdate.com/.*\.(cab|exe|psf) 10080 90%
 99 ignore-no-cache override-expire ignore-private
 refresh_pattern ^http://sjl-v[0-9]+\.sjl\.youtube\.com 10080 90% 99
 ignore-no-cache override-expire ignore-private
 
 #Store  script
 
 #!/usr/bin/perl
 $|=1;
 while () {
   @X = split;
   $url = $X[0];
   $url =~
 [EMAIL PROTECTED]://(.*?)/get_video\?(.*)video_id=(.*?)[EMAIL 
 PROTECTED]://videos.youtube.INTERNAL/ID=$3@;
   $url =~
 [EMAIL PROTECTED]://(.*?)/get_video\?(.*)video_id=(.*?)[EMAIL 
 PROTECTED]://videos.youtube.INTERNAL/ID=$3@;
   $url =~
 [EMAIL PROTECTED]://(.*?)/videodownload\?(.*)docid=(.*?)[EMAIL 
 PROTECTED]://videos.google.INTERNAL/ID=$3@;
   $url =~
 [EMAIL PROTECTED]://(.*?)/videodownload\?(.*)docid=(.*?)[EMAIL 
 PROTECTED]://videos.google.INTERNAL/ID=$3@;
   $url =~
 [EMAIL PROTECTED]://(.*?)/update\?(.*)video_id=(.*?)[EMAIL 
 PROTECTED]://au.download.windowsupdate.com.INTERNAL/ID=$3@;
   $url =~
 [EMAIL PROTECTED]://(.*?)/update\?(.*)video_id=(.*?)[EMAIL 
 PROTECTED]://au.download.windowsupdate.com.INTERNAL/ID=$3@;
   print $url\n;
 }
 
 ### output cache log 
 1213248096.431606 192.168.0.5 TCP_MISS/206 15348 GET
 http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
 - DIRECT/199.93.42.124 application/octet-stream
 1213248098.070905 192.168.0.5 TCP_MISS/206 36487 GET
 http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
 - DIRECT/199.93.42.124 multipart/byteranges
 1213248099.996   1535 192.168.0.5 TCP_MISS/206 40838 GET
 http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
 - DIRECT/8.12.137.30 multipart/byteranges
 1213248101.372   1216 192.168.0.5 TCP_MISS/206 14687 GET
 http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
 - DIRECT/209.84.7.123 application/octet-stream
 1213248101.749202 192.168.0.5 TCP_MISS/200 375 HEAD
 http://download.windowsupdate.com/v7/windowsupdate/redir/wuredir.cab?0806120622
 - DIRECT/79.140.80.33 application/octet-stream
 1213248102.091606 192.168.0.5 TCP_MISS/206 12929 GET
 http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
 - DIRECT/209.84.7.123 application/octet-stream
 1213248103.755962 192.168.0.5 TCP_MISS/206 33762 GET
 http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
 - DIRECT/209.84.7.123 multipart/byteranges
 1213248104.624578 192.168.0.5 TCP_MISS/200 375 HEAD
 http://www.update.microsoft.com/v7/windowsupdate/selfupdate/wuident.cab?0806120623
 - DIRECT/65.55.13.158 application/octet-stream
 1213248104.831100 192.168.0.5 TCP_MISS/200 376 HEAD
 http://download.windowsupdate.com/v7/windowsupdate/a/selfupdate/WSUS3/x86/Other/wsus3setup.cab?0806120623
 - DIRECT/79.140.80.33 application/octet-stream
 1213248105.266431 192.168.0.5 TCP_MISS/200 25737 GET
 http://download.windowsupdate.com/v7/windowsupdate/a/selfupdate/WSUS3/x86/Other/wsus3setup.cab?0806120623
 - DIRECT/79.140.80.33 application/octet-stream
 1213248105.638   1529 192.168.0.5 TCP_MISS/206 36542 GET
 http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
 - DIRECT/199.93.42.124 application/octet-stream
 1213248106.175409 192.168.0.5 TCP_MISS/206 13595 GET
 http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
 - DIRECT/199.93.42.124 multipart/byteranges
 1213248106.595102 192.168.0.5 TCP_MISS/200 375 HEAD
 http://download.windowsupdate.com/v7/windowsupdate/redir/wuredir.cab?0806120623
 - DIRECT/79.140.80.33 application/octet-stream
 1213248108.882   1832 192.168.0.5 TCP_MISS/206 45373 GET
 http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
 - DIRECT/8.12.137.30 application/octet-stream
 1213248109.603608 192.168.0.5 TCP_MISS/206 16132 GET

Re: [squid-users] cached MS updates !

2008-06-15 Thread Henrik Nordstrom 
On sön, 2008-06-15 at 06:40 -0700, pokeman wrote:
 no one explane this :(((

Didn't understand there was a question.

What is the question?

  1213248111.272979 192.168.0.5 TCP_MISS/206 44097 GET
  http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
  - DIRECT/8.12.137.30 multipart/byteranges

I guess you ask whi this isn't cached, it's because it's a partial
request, only requesting parts of the object, and Squid can not yet
cache partial objects.

Regards
Henrik


signature.asc
Description: This is a digitally signed message part

[squid-users] cached MS updates !

2008-06-11 Thread pokeman 

hi there 
Refrence to following atricle 
http://www.nabble.com/Re%3A-YouTube-and-other-streaming-media-%28caching%29-p17738020.html
i am going to cached windowsupdate object here is changes in store script in
squid.conf and output log 

Squid.conf
acl store_rewrite_list url_regex ^http://(.*?)/windowsupdate\?

refresh_pattern windowsupdate.com/.*\.(cab|exe|dll) 10080 90% 99
ignore-no-cache override-expire ignore-private
refresh_pattern download.microsoft.com/.*\.(cab|exe|dll) 10080 90% 99
ignore-no-cache override-expire ignore-private
refresh_pattern au.download.windowsupdate.com/.*\.(cab|exe|psf) 10080 90%
99 ignore-no-cache override-expire ignore-private
refresh_pattern ^http://sjl-v[0-9]+\.sjl\.youtube\.com 10080 90% 99
ignore-no-cache override-expire ignore-private

#Store  script

#!/usr/bin/perl
$|=1;
while () {
  @X = split;
  $url = $X[0];
  $url =~
[EMAIL PROTECTED]://(.*?)/get_video\?(.*)video_id=(.*?)[EMAIL 
PROTECTED]://videos.youtube.INTERNAL/ID=$3@;
  $url =~
[EMAIL PROTECTED]://(.*?)/get_video\?(.*)video_id=(.*?)[EMAIL 
PROTECTED]://videos.youtube.INTERNAL/ID=$3@;
  $url =~
[EMAIL PROTECTED]://(.*?)/videodownload\?(.*)docid=(.*?)[EMAIL 
PROTECTED]://videos.google.INTERNAL/ID=$3@;
  $url =~
[EMAIL PROTECTED]://(.*?)/videodownload\?(.*)docid=(.*?)[EMAIL 
PROTECTED]://videos.google.INTERNAL/ID=$3@;
  $url =~
[EMAIL PROTECTED]://(.*?)/update\?(.*)video_id=(.*?)[EMAIL 
PROTECTED]://au.download.windowsupdate.com.INTERNAL/ID=$3@;
  $url =~
[EMAIL PROTECTED]://(.*?)/update\?(.*)video_id=(.*?)[EMAIL 
PROTECTED]://au.download.windowsupdate.com.INTERNAL/ID=$3@;
  print $url\n;
}

### output cache log 
1213248096.431606 192.168.0.5 TCP_MISS/206 15348 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/199.93.42.124 application/octet-stream
1213248098.070905 192.168.0.5 TCP_MISS/206 36487 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/199.93.42.124 multipart/byteranges
1213248099.996   1535 192.168.0.5 TCP_MISS/206 40838 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/8.12.137.30 multipart/byteranges
1213248101.372   1216 192.168.0.5 TCP_MISS/206 14687 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/209.84.7.123 application/octet-stream
1213248101.749202 192.168.0.5 TCP_MISS/200 375 HEAD
http://download.windowsupdate.com/v7/windowsupdate/redir/wuredir.cab?0806120622
- DIRECT/79.140.80.33 application/octet-stream
1213248102.091606 192.168.0.5 TCP_MISS/206 12929 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/209.84.7.123 application/octet-stream
1213248103.755962 192.168.0.5 TCP_MISS/206 33762 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/209.84.7.123 multipart/byteranges
1213248104.624578 192.168.0.5 TCP_MISS/200 375 HEAD
http://www.update.microsoft.com/v7/windowsupdate/selfupdate/wuident.cab?0806120623
- DIRECT/65.55.13.158 application/octet-stream
1213248104.831100 192.168.0.5 TCP_MISS/200 376 HEAD
http://download.windowsupdate.com/v7/windowsupdate/a/selfupdate/WSUS3/x86/Other/wsus3setup.cab?0806120623
- DIRECT/79.140.80.33 application/octet-stream
1213248105.266431 192.168.0.5 TCP_MISS/200 25737 GET
http://download.windowsupdate.com/v7/windowsupdate/a/selfupdate/WSUS3/x86/Other/wsus3setup.cab?0806120623
- DIRECT/79.140.80.33 application/octet-stream
1213248105.638   1529 192.168.0.5 TCP_MISS/206 36542 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/199.93.42.124 application/octet-stream
1213248106.175409 192.168.0.5 TCP_MISS/206 13595 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/199.93.42.124 multipart/byteranges
1213248106.595102 192.168.0.5 TCP_MISS/200 375 HEAD
http://download.windowsupdate.com/v7/windowsupdate/redir/wuredir.cab?0806120623
- DIRECT/79.140.80.33 application/octet-stream
1213248108.882   1832 192.168.0.5 TCP_MISS/206 45373 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/8.12.137.30 application/octet-stream
1213248109.603608 192.168.0.5 TCP_MISS/206 16132 GET
http://au.download.windowsupdate.com/msdownload/update/v5/psf/windowsxp-kb902400-x86-enu_a7c593892442e90b74d93abf0524a52f00998cea.psf
- DIRECT/8.12.137.30 application/octet-stream