Hi Solomon,
Solomon Asare wrote:
Hi,
--- Manoj_Rajkarnikar [EMAIL PROTECTED] wrote:
Great job solomon. Many of us have been trying to
achieve similar with
youtube and google vids. this will help a great
deal. how big of a
cachedir do you keep for youtube vids. should be
quite a big to be
Hi,
--- Tek Bahadur Limbu [EMAIL PROTECTED] wrote:
Are you intending to run a single cache of 500 GB in
size or a couple of
proxy caches amounting to 500 GB in size?
It's because running a 500 GB cache in a single
machine is going to
cause you problems along the way. Such a large cache
On Mon, Oct 08, 2007, Solomon Asare wrote:
If for some reasons, your cache gets corrupted, it
might take a very
long time to fix it and I am sure that Squid's
median response might
will get higher.
Anyway, it's just my suggestion.
Now that you have mentioned it I will do some
Hi,
--- Adrian Chadd [EMAIL PROTECTED] wrote:
That said, you're currently caching the videos in
the apache proxy and not in the
Squid proxy.
Adrian
Thanks for the info on large file sizes and memory
requirements. I store the objects in squid, not in
apache. The apache is a
On Mon, Oct 08, 2007, Solomon Asare wrote:
Thanks for the info on large file sizes and memory
requirements. I store the objects in squid, not in
apache. The apache is a non-caching proxy.
Essentially, it rewrites the headers to clear the
no-store, expiration, etc., limitations. Thats all.
Hi,
--- Adrian Chadd [EMAIL PROTECTED] wrote:
I'll have to look some more into it later on. Squid
could probably
be patched to do what you're using Apache for..
Adrian
That will be great, but what I don't understand is why
they don't want to make such a static object
cacheable.
On Mon, Oct 08, 2007, Solomon Asare wrote:
That will be great, but what I don't understand is why
they don't want to make such a static object
cacheable. Microsoft, Google, and those whose traffic
take up most of the Internet's capacity should make
their content cacheable so as to help all
Hi All,
pls should anyone want to try the scripts I posted, do
not use /tmp.
I irretrievably trashed my 300+ rules which have been
built over a week. I now have to crawl up all over
again. I wonder why I didn't see this coming. You may
use /var/log/squid/.
Thanks,
solomon.
Ah.. a Gotcha !!
Noted.
Thanks
Manoj
On Mon, 8 Oct 2007, Solomon Asare wrote:
Hi All,
pls should anyone want to try the scripts I posted, do
not use /tmp.
I irretrievably trashed my 300+ rules which have been
built over a week. I now have to crawl up all over
again. I wonder why I didn't
Hi All,
Hi All,
a small success:
I have set a an apache2.2 server as a proxy without
caching as a parent proxy to my squid. I pass my
youtube video clips through this parent. The apache
is
on the same machine as the squid. Using the
mod_header
module in apache, I cleaned out all the
Hi All,
the long skelatel howto:
THE ENVIROMENT.
Ubuntu, Squid 2.6, Apache 2.2, a small ISP with about
11% www.youtube.com traffic, 2Mbps on submarine fibre
to the US cost about US$5,000 - US$7,000 over here -
Accra, Ghana.
THE PROBLEM
Some Youtube clips are not cacheable, even with the
overides
On Sun, 7 Oct 2007, Solomon Asare wrote:
Hi All,
the long skelatel howto:
8. COMMENTS
This is only one of many ways that this goal can be
achieved and certailnly not the best being a non-guru,
although a determined linux user. I guess the features
I couldn't find in squid2.6-stable that made
Hi,
--- Manoj_Rajkarnikar [EMAIL PROTECTED] wrote:
Great job solomon. Many of us have been trying to
achieve similar with
youtube and google vids. this will help a great
deal. how big of a
cachedir do you keep for youtube vids. should be
quite a big to be able to
cache the vids in
Hi All,
a small success:
I have set a an apache2.2 server as a proxy without
caching as a parent proxy to my squid. I pass my
youtube video clips through this parent. The apache is
on the same machine as the squid. Using the mod_header
module in apache, I cleaned out all the worrisome
headers in
On mån, 2007-09-24 at 07:42 -0700, zulkarnain wrote:
I'm having the same problem, any solution to handle
this? thanks!
Solution:
0. Make sure the cache directive has been disabled. The distributed
configuration file blocks caching of URLs with ? or cgi-bin in them..
1. Understand why the
I'm having the same problem, any solution to handle
this? thanks!
Zul
--- Solomon Asare [EMAIL PROTECTED] wrote:
Hi All,
sorry, the refresh_pattern looked like:
refresh_pattern -i
get\_video\?video\_id\=.*youtube\.com 10080 990%
reload-into-ims ignore-no-cache
override-expire
Hi All,
I have had some success in caching expired objects
with squid3 as shown below:
1190548054.719 SWAPOUT 00 0018
55122D5A03E0C43DBA15AFDF9225215B 200-1
-1 1190548026 video/flv 1626399/1626399 GET
Hi All,
sorry, the refresh_pattern looked like:
refresh_pattern -i
get\_video\?video\_id\=.*youtube\.com 10080 990%
reload-into-ims ignore-no-cache
override-expire ignore-private ignore-no-store
Regards,
solomon.
--- Solomon Asare [EMAIL PROTECTED] wrote:
Hi All,
I have had
Hi Henrik,
I have tried quite a lot, eg:
refresh_pattern -i \.flv$ 10080 990%
99 reload-into-ims ignore-no-cache
It caches only those objects which have not already
expired that is with the right combinations of
Last-Modified or ETag minimum_expiry_time; as you
explained earlier.
On ons, 2007-09-19 at 01:45 -0700, Solomon Asare wrote:
Hi Henrik,
I have tried quite a lot, eg:
refresh_pattern -i \.flv$ 10080 990%
99 reload-into-ims ignore-no-cache
It caches only those objects which have not already
expired that is with the right combinations of
Hi Henrik,
--- Henrik Nordstrom [EMAIL PROTECTED]
wrote:
Have you tried override-expire?
yes, I have tried overide-expire without success, as
in:
refresh_pattern -i \.flv$ 10080 990%
99 ignore-no-cache override-expire ignore-private
Thanks,
solomon.
On ons, 2007-09-19 at 05:36 -0700, Solomon Asare wrote:
yes, I have tried overide-expire without success, as
in:
refresh_pattern -i \.flv$ 10080 990%
99 ignore-no-cache override-expire ignore-private
And what do the response headers look like for the object in question?
Hi Henrik,
--- Henrik Nordstrom [EMAIL PROTECTED]
wrote:
And what do the response headers look like for the
object in question?
Some Header Info from my logs on the objects that will
not cache:
Keep-Alive: 300\r\nProxy-Connection: keep-alive\r\n]
[HTTP/1.1 200 OK\r\nPragma:
On ons, 2007-09-19 at 12:40 -0700, Solomon Asare wrote:
Connection: Keep-Alive\r\n] [HTTP/1.1 200
OK\r\nPragma: no-cache\r\nExpires: Sat, 17 Jan 1981
8:00:00 GMT\r\nCache-Control: no-store, no-cache,
must-revalidate\r\nContent-Type:
video/flv\r\nContent-Length: 7672205\r\n
Are they
Hi Henrik,
it looks hopeful, I will try your suggestion, Squid 3.
Thanks again. I will report back. Already, just after
deploying squid for about a week, I am saving 20% on
banndwidth.
Thanks,
solomon.
--- Henrik Nordstrom [EMAIL PROTECTED]
wrote:
On ons, 2007-09-19 at 12:40 -0700, Solomon
Hi Henrik,
thanks for your insightful response. However, the
object is a .flv file that hasn't changed in months.
The origin server certainly doesn't want the object
cached, but I want to. Any leads that can help me
achieve this?
Regards,
solomon.
--- Henrik Nordstrom [EMAIL PROTECTED]
wrote:
On Tue, Sep 18, 2007, Solomon Asare wrote:
Hi Henrik,
thanks for your insightful response. However, the
object is a .flv file that hasn't changed in months.
The origin server certainly doesn't want the object
cached, but I want to. Any leads that can help me
achieve this?
* set your
On tis, 2007-09-18 at 02:55 -0700, Solomon Asare wrote:
This is the exact problem I have that I am trying to
resolve, not querry string issues. If only I can
overide the lack of Last-Modified, Etag and not
meeting minimum_expiry_time conditions.
There would be no use doing so. All you would
Hi Henrik,
since you say so, I have rather been toying with the
idea of saving these supposedly expired objects in an
apache document root and using the url_rewrite of the
squid to fetch the objects from my apache server. I
hope the bandwidth savings will justify the bandwidth
cost in repopulating
On tis, 2007-09-18 at 09:25 -0700, Solomon Asare wrote:
Hi Henrik,
since you say so, I have rather been toying with the
idea of saving these supposedly expired objects in an
apache document root and using the url_rewrite of the
squid to fetch the objects from my apache server. I
hope the
Hi All,
please, to recast, how do I cache expired objects. I
get responses with expiry dates being in the past from
some servers that I will want to cache.
Regards,
solomon.
On Mon, Sep 17, 2007, Solomon Asare wrote:
Hi All,
please, to recast, how do I cache expired objects. I
get responses with expiry dates being in the past from
some servers that I will want to cache.
refresh_pattern
adrian
Hi,
just to clarify: I don't mean getting a HIT, just
caching the object into my store. Any link to a
refresh_pattern that will cache an object that has
expired for about 60 secs by the time you fetch it?
Regards,
solomon.
--- Adrian Chadd [EMAIL PROTECTED] wrote:
On Mon, Sep 17, 2007,
Solomon Asare wrote:
Hi,
just to clarify: I don't mean getting a HIT, just
caching the object into my store. Any link to a
refresh_pattern that will cache an object that has
expired for about 60 secs by the time you fetch it?
34 matches
Mail list logo
