Re: [squid-users] squid cant cache flv (youtube)
so that means it`s impossible to cache youtube using squid now ? Manoj_Rajkarnikar wrote: On Sun, 26 Aug 2007, Kris wrote: Tried to put reload-into-ims but got same case , youtube still cant be cached. any clue ? already discussed this in another thread with subject refresh patterns. in the full url of the youtube video, there are few parameters that are never same. so basically everytime you request for the same file, there url for it is different than the other one and thus will never get hit unless someone writes a workaround/patch to rewrite the urls while storing and looking up youtube videos. Manoj
Re: [squid-users] squid cant cache flv (youtube)
On Mon, Aug 27, 2007, Kris wrote: so that means it`s impossible to cache youtube using squid now ? Its possible to partially cache youtube. Fully caching youtube requires two particular additions to Squid. Earlier posts in the thread cover what they are. Adrian
Re: [squid-users] squid cant cache flv (youtube)
On Mon, 27 Aug 2007, Kris wrote: so that means it`s impossible to cache youtube using squid now ? Yes It does appear so. FYI its not entire youtube content that's uncacheable, only the flash videos and some image files. you can get hit on rest of the thumbnail images and contents though. Manoj --
Re: [squid-users] squid cant cache flv (youtube)
On Mon, Aug 27, 2007, Manoj_Rajkarnikar wrote: Yes It does appear so. FYI its not entire youtube content that's uncacheable, only the flash videos and some image files. you can get hit on rest of the thumbnail images and contents though. And I'm telling you, its possible to partially cache youtube video content without modifying Squid. Adrian
Re: [squid-users] squid cant cache flv (youtube)
If you know and got it worked on your system, do you mind if you share you conf to us ? . Adrian Chadd wrote: On Mon, Aug 27, 2007, Manoj_Rajkarnikar wrote: Yes It does appear so. FYI its not entire youtube content that's uncacheable, only the flash videos and some image files. you can get hit on rest of the thumbnail images and contents though. And I'm telling you, its possible to partially cache youtube video content without modifying Squid. Adrian
Re: [squid-users] squid cant cache flv (youtube)
On Mon, Aug 27, 2007, Kris wrote: If you know and got it worked on your system, do you mind if you share you conf to us ? . Yes. :) I can't give away trade secrets, can I? :) I've posted all my Youtube config snippets here over the last couple of weeks. So unless Youtube changed in the last week or so it should work just as well as I and others are seeing it work. I'm sorry but I don't have the time to figure out why its just not working for others. Similarly, I never have trouble with WCCPv2 under FreeBSD/Linux but others seem to never quite get it right. Its why I'm building this appliance.. Adrian
Re: [squid-users] squid cant cache flv (youtube)
Probably, If all of us, the squid admin and users will contribute in the way that it should be, making more donations probably, just probably sponsoring will be not needed. Kris escribió: If you know and got it worked on your system, do you mind if you share you conf to us ? . Adrian Chadd wrote: On Mon, Aug 27, 2007, Manoj_Rajkarnikar wrote: Yes It does appear so. FYI its not entire youtube content that's uncacheable, only the flash videos and some image files. you can get hit on rest of the thumbnail images and contents though. And I'm telling you, its possible to partially cache youtube video content without modifying Squid. Adrian
Re: [squid-users] squid cant cache flv (youtube)
Tried to put reload-into-ims but got same case , youtube still cant be cached. any clue ? Kris wrote: do you mind if you post your conf here ? or send me private , very thx b4 Adrian Chadd wrote: On Sat, Aug 25, 2007, Kris wrote: so i must put reload-into-ims on refresh pattern for flv/swf ? You can try that. All I know is that I'm able to cache Youtube right now. ;0 adrian
Re: [squid-users] squid cant cache flv (youtube)
--- Kris [EMAIL PROTECTED] wrote: Tried to put reload-into-ims but got same case , youtube still cant be cached. any clue ? Kris, Change reload-into-ims to ignore-no-cache. Regards, Zul Ready for the edge of your seat? Check out tonight's top picks on Yahoo! TV. http://tv.yahoo.com/
Re: [squid-users] squid cant cache flv (youtube)
Tied it but no luck. still cant cache youtube T_T zulkarnain wrote: --- Kris [EMAIL PROTECTED] wrote: Tried to put reload-into-ims but got same case , youtube still cant be cached. any clue ? Kris, Change reload-into-ims to ignore-no-cache. Regards, Zul Ready for the edge of your seat? Check out tonight's top picks on Yahoo! TV. http://tv.yahoo.com/
Re: [squid-users] squid cant cache flv (youtube)
On Sun, 26 Aug 2007, Kris wrote: Tried to put reload-into-ims but got same case , youtube still cant be cached. any clue ? already discussed this in another thread with subject refresh patterns. in the full url of the youtube video, there are few parameters that are never same. so basically everytime you request for the same file, there url for it is different than the other one and thus will never get hit unless someone writes a workaround/patch to rewrite the urls while storing and looking up youtube videos. Manoj --
Re: [squid-users] squid cant cache flv (youtube)
On Sat, Aug 25, 2007, Kris wrote: so i must put reload-into-ims on refresh pattern for flv/swf ? You can try that. All I know is that I'm able to cache Youtube right now. ;0 adrian
Re: [squid-users] squid cant cache flv (youtube)
do you mind if you post your conf here ? or send me private , very thx b4 Adrian Chadd wrote: On Sat, Aug 25, 2007, Kris wrote: so i must put reload-into-ims on refresh pattern for flv/swf ? You can try that. All I know is that I'm able to cache Youtube right now. ;0 adrian
Re: [squid-users] squid cant cache flv (youtube)
On Fri, Aug 24, 2007, Kris wrote: I planned to cache youtube flv using squid Yup. At the very least: acl youtube dstdomain .youtube.com cache allow youtube Then unfortunately some work needs to be done to Squid to allow URLs to be made equivalent so all the various youtube video servers are considered as the same host. This step will allow google earth/maps to be cached effectively too. So, who would like to sponsor some work to make caching Google Maps/Earth and video sites like Youtube actually work? Adrian
Re: [squid-users] squid cant cache flv (youtube)
so you got your proxy didnt cache flv file in youtube too ? Adrian Chadd wrote: On Fri, Aug 24, 2007, Kris wrote: I planned to cache youtube flv using squid Yup. At the very least: acl youtube dstdomain .youtube.com cache allow youtube Then unfortunately some work needs to be done to Squid to allow URLs to be made equivalent so all the various youtube video servers are considered as the same host. This step will allow google earth/maps to be cached effectively too. So, who would like to sponsor some work to make caching Google Maps/Earth and video sites like Youtube actually work? Adrian
Re: [squid-users] squid cant cache flv (youtube)
Kris wrote: I planned to cache youtube flv using squid my squid : [EMAIL PROTECTED]:~# squid -v Squid Cache: Version 2.6.STABLE13 my conf was like this : acl video_cache dstdomain .youtube.com .google.com .llnwd.net .dailymotion.com .friendster.com .googlevideo.com acl video_regex urlpath_regex get_video cache allow video_cache cache allow video_regex hierarchy_stoplist cgi-bin ? acl QUERY urlpath_regex cgi-bin \? cache deny QUERY cache_mem 1024 MB cache_swap_low 90 cache_swap_high 95 maximum_object_size 50 MB minimum_object_size 1 KB maximum_object_size_in_memory 1 MB i tried to access one of flv video in youtube but i never hot TCP_HIT, it always appear TCP_MISS (also refresh page by press F5). access.log was like this : [24/Aug/2007:18:47:45 +0700] GET http://74.125.15.24/get_video? HTTP/1.1 200 1176075 TCP_MISS:DIRECT then i refresh page by press F5 [24/Aug/2007:18:48:15 +0700] GET http://74.125.15.24/get_video? HTTP/1.1 200 1176075 TCP_MISS:DIRECT any clue ? Turning off strip_query_terms and turning on log_mime_hdrs showed the following response headers in access.log (for http://74.125.15.33/get_video?video_id=FJug16NlqPk): HTTP/1.1 200 OK Pragma: no-cache Expires: Sat, 17 Jan 1981 8:00:00 GMT Cache-Control: no-store, no-cache, must-revalidate Content-Type: video/flv Content-Length: 989350 Connection: close They are serious about making sure this content is not cached. Chris
Re: [squid-users] squid cant cache flv (youtube)
On Fri, Aug 24, 2007, Chris Robertson wrote: Turning off strip_query_terms and turning on log_mime_hdrs showed the following response headers in access.log (for http://74.125.15.33/get_video?video_id=FJug16NlqPk): HTTP/1.1 200 OK Pragma: no-cache Expires: Sat, 17 Jan 1981 8:00:00 GMT Cache-Control: no-store, no-cache, must-revalidate Content-Type: video/flv Content-Length: 989350 Connection: close They are serious about making sure this content is not cached. Hint: Squid can be told to ignore all of that that. (Come on site designers - as long as you support IMS properly you're still going to have control over your precious content, and we get to save on bandwidth costs. How's about it, eh?) Adrian
