RE: [squid-users] Squid 3.1 youtube caching
On Thu, 3 Feb 2011 10:03:03 +0530, Saurabh Agarwal wrote: > Hi Luis > > I have recently successfully cached youtube videos using Squid-2.7.Stable7 > and posted the solution on squid mailing list as well. I tested it > yesterday and youtube videos were still being cached. AFAICT your 23rd Nov 2010 posted configuration differs from the wiki example by: * passing every single URL passing through your proxy goes to the storeurl program (not just the relevant YT URLs) * ignoring updates and changes to the HTML pages (forcing people to think profiles are not being updated etc) * ignoring users force-refresh (so that if somebody does notice a page problem caused by the above they can't manually force the cache to update the page) None of these have any obvious or explained reasons relating to the .FLV video which is the only relevant piece to be de-duplicated. Your re-writer adds two interesting URLs to the altered pot. * If that generate_204 is what I think then you are preventing users from fast-forwarding videos, forcing them to re-download the entire thing from cache if they try. * the "docid=" pages. Can you explain what those are and how their URLs result in a .FLV object response? I'm ignoring the 10th Nov and 1st Nov and April and July and August configurations because YT change their URLs occasionally. That is the point of using the wiki to publish latest details instead of a long-term mailing list. If you find the wiki setup is not working please get yourself an editing account and add a message to the *Discussion* page outlining the YT operations which are being missed and what changes will catch them. When somebody can independently verify their success we add the changes to the main config. > For Squid3.1 I have > not tried yet. 3.x do not yet have the storeurl feature these hacks all rely upon. Amos
RE: [squid-users] Squid 3.1 youtube caching
Hi Luis I have recently successfully cached youtube videos using Squid-2.7.Stable7 and posted the solution on squid mailing list as well. I tested it yesterday and youtube videos were still being cached. For Squid3.1 I have not tried yet. Please do a google for squid mails with subject "Caching youtube videos problem/ always getting TCP_MISS" Regards, Saurabh -Original Message- From: Luis Daniel Lucio Quiroz [mailto:luis.daniel.lu...@gmail.com] Sent: Thursday, February 03, 2011 12:09 AM To: Hasanen AL-Bana Cc: Clemente Aguiar; squid-users@squid-cache.org Subject: Re: [squid-users] Squid 3.1 youtube caching Le mercredi 2 février 2011 12:29:58, Hasanen AL-Bana a écrit : > No need for ICAP , storeurl script should be enough. > The problem is that youtube internal links are changing from time to > time, so we need to update our scripts from time to time. > > On Wed, Feb 2, 2011 at 8:23 PM, Clemente Aguiar > > wrote: > > Qua, 2011-02-02 às 10:01 -0600, Luis Daniel Lucio Quiroz escreveu: > > > Le mercredi 2 février 2011 09:49:23, Clemente Aguiar a écrit : > > > > I am running squid 3.1.9, and I would like to know if this version is > > > > able to cache youtube content? > > > > > > > > I did check the wiki > > > > (http://wiki.squid-cache.org/ConfigExamples/DynamicContent/YouTube) > > > > and I must say that it is not clear what bits applies to version 3.1. > > > > > > > > Can somebody give me some pointers to what exactly I should > > > > configure. > > > > > > > > Thanks, > > > > Clemente > > > > > > Clemente, > > > > > > there is a non 100% sure probability because 3.1 laks 2.7 capabilities, > > > the only way for now is: > > > use 2.7 > > > user an ICAP server capable to manage those types of urls > > > > > > Regards, > > > > > > LD > > > > Ok, thanks. > > > > Maybe somebody should make that (perfectly) clear in the wiki ... and > > maybe add an example on how to implement ICAP server. > > > > Well, now for the next question. Which ICAP server and how to implement? > > Can you help me? > > > > Regards, > > Clemente store_url is for 2.7 not for 3.1, he must use 3.1+ icap if he want to get similar results i can recomend you i-cap for linuxbut it lacks what you want, how ever it has some templates so you can code the things you want LD
Re: [squid-users] Squid 3.1 youtube caching
Le mercredi 2 février 2011 12:29:58, Hasanen AL-Bana a écrit : > No need for ICAP , storeurl script should be enough. > The problem is that youtube internal links are changing from time to > time, so we need to update our scripts from time to time. > > On Wed, Feb 2, 2011 at 8:23 PM, Clemente Aguiar > > wrote: > > Qua, 2011-02-02 às 10:01 -0600, Luis Daniel Lucio Quiroz escreveu: > > > Le mercredi 2 février 2011 09:49:23, Clemente Aguiar a écrit : > > > > I am running squid 3.1.9, and I would like to know if this version is > > > > able to cache youtube content? > > > > > > > > I did check the wiki > > > > (http://wiki.squid-cache.org/ConfigExamples/DynamicContent/YouTube) > > > > and I must say that it is not clear what bits applies to version 3.1. > > > > > > > > Can somebody give me some pointers to what exactly I should > > > > configure. > > > > > > > > Thanks, > > > > Clemente > > > > > > Clemente, > > > > > > there is a non 100% sure probability because 3.1 laks 2.7 capabilities, > > > the only way for now is: > > > use 2.7 > > > user an ICAP server capable to manage those types of urls > > > > > > Regards, > > > > > > LD > > > > Ok, thanks. > > > > Maybe somebody should make that (perfectly) clear in the wiki ... and > > maybe add an example on how to implement ICAP server. > > > > Well, now for the next question. Which ICAP server and how to implement? > > Can you help me? > > > > Regards, > > Clemente store_url is for 2.7 not for 3.1, he must use 3.1+ icap if he want to get similar results i can recomend you i-cap for linuxbut it lacks what you want, how ever it has some templates so you can code the things you want LD
Re: [squid-users] Squid 3.1 youtube caching
No need for ICAP , storeurl script should be enough. The problem is that youtube internal links are changing from time to time, so we need to update our scripts from time to time. On Wed, Feb 2, 2011 at 8:23 PM, Clemente Aguiar wrote: > > Qua, 2011-02-02 às 10:01 -0600, Luis Daniel Lucio Quiroz escreveu: > > Le mercredi 2 février 2011 09:49:23, Clemente Aguiar a écrit : > > > I am running squid 3.1.9, and I would like to know if this version is > > > able to cache youtube content? > > > > > > I did check the wiki > > > (http://wiki.squid-cache.org/ConfigExamples/DynamicContent/YouTube) > > > and I must say that it is not clear what bits applies to version 3.1. > > > > > > Can somebody give me some pointers to what exactly I should configure. > > > > > > Thanks, > > > Clemente > > > > Clemente, > > > > there is a non 100% sure probability because 3.1 laks 2.7 capabilities, the > > only way for now is: > > use 2.7 > > user an ICAP server capable to manage those types of urls > > > > Regards, > > > > LD > > Ok, thanks. > > Maybe somebody should make that (perfectly) clear in the wiki ... and > maybe add an example on how to implement ICAP server. > > Well, now for the next question. Which ICAP server and how to implement? > Can you help me? > > Regards, > Clemente > >
Re: [squid-users] Squid 3.1 youtube caching
Qua, 2011-02-02 às 10:01 -0600, Luis Daniel Lucio Quiroz escreveu: > Le mercredi 2 février 2011 09:49:23, Clemente Aguiar a écrit : > > I am running squid 3.1.9, and I would like to know if this version is > > able to cache youtube content? > > > > I did check the wiki > > (http://wiki.squid-cache.org/ConfigExamples/DynamicContent/YouTube) > > and I must say that it is not clear what bits applies to version 3.1. > > > > Can somebody give me some pointers to what exactly I should configure. > > > > Thanks, > > Clemente > > Clemente, > > there is a non 100% sure probability because 3.1 laks 2.7 capabilities, the > only way for now is: > use 2.7 > user an ICAP server capable to manage those types of urls > > Regards, > > LD Ok, thanks. Maybe somebody should make that (perfectly) clear in the wiki ... and maybe add an example on how to implement ICAP server. Well, now for the next question. Which ICAP server and how to implement? Can you help me? Regards, Clemente
Re: [squid-users] Squid 3.1 youtube caching
Le mercredi 2 février 2011 09:49:23, Clemente Aguiar a écrit : > I am running squid 3.1.9, and I would like to know if this version is > able to cache youtube content? > > I did check the wiki > (http://wiki.squid-cache.org/ConfigExamples/DynamicContent/YouTube) > and I must say that it is not clear what bits applies to version 3.1. > > Can somebody give me some pointers to what exactly I should configure. > > Thanks, > Clemente Clemente, there is a non 100% sure probability because 3.1 laks 2.7 capabilities, the only way for now is: use 2.7 user an ICAP server capable to manage those types of urls Regards, LD
