mass purge causes high load?

2008-04-10 Thread Sascha Ottolski
Hi, I just needed to get rid of about 27,000 stale URLs, that were cached as 404 or 302 due to a configuration error on the backends. So I did a url.purge in a loop, sleeping 0.1 seconds after each URL: for i in `cat notfound.txt.sorted` ; do varnishadm -T:81 url.purge $i; sleep 0.1; done How

Re: mass purge causes high load?

2008-04-13 Thread Dag-Erling Smørgrav
Sascha Ottolski <[EMAIL PROTECTED]> writes: > I just needed to get rid of about 27,000 stale URLs, that were cached as > 404 or 302 due to a configuration error on the backends. Why couldn't you just wait for them to expire? > So I did a url.purge in a loop, sleeping 0.1 seconds after each URL:

Re: mass purge causes high load?

2008-04-13 Thread Sascha Ottolski
Am Sonntag 13 April 2008 12:08:55 schrieben Sie: > Sascha Ottolski <[EMAIL PROTECTED]> writes: > > I just needed to get rid of about 27,000 stale URLs, that were > > cached as 404 or 302 due to a configuration error on the backends. > > Why couldn't you just wait for them to expire? If I only knew

Re: mass purge causes high load?

2008-04-14 Thread Dag-Erling Smørgrav
[resent to varnish-misc] Sascha Ottolski <[EMAIL PROTECTED]> writes: > Dag-Erling Smørgrav <[EMAIL PROTECTED]> writes: > > If you know the exact URL to purge, use an HTTP PURGE (see VCL code > > examples in the vcl man page) > I'm aware of this, but had expected that the semantic of both method >

Re: mass purge causes high load?

2008-04-14 Thread Dag-Erling Smørgrav
Sascha Ottolski <[EMAIL PROTECTED]> writes: > Dag-Erling Smørgrav <[EMAIL PROTECTED]> writes: > > No, the semantics are completely different. With HTTP PURGE, you do > > a direct cache lookup, and set the object's TTL to 0 if it exists. > > With url.purge, you add an entry to a ban list, and ever

Re: mass purge causes high load?

2008-04-14 Thread Sascha Ottolski
Am Montag 14 April 2008 14:19:11 schrieb Dag-Erling Smørgrav: > Sascha Ottolski <[EMAIL PROTECTED]> writes: > > Dag-Erling Smørgrav <[EMAIL PROTECTED]> writes: > > > No, the semantics are completely different. With HTTP PURGE, you > > > do a direct cache lookup, and set the object's TTL to 0 if it

Re: mass purge causes high load?

2008-04-14 Thread Poul-Henning Kamp
In message <[EMAIL PROTECTED]>, Sascha Ottolski writes: >thanks again. If I get it right, the ban list never shrinks, so I >probably have 17,000 ban list entries hanging around. can I purge this >list somehow, other than restarting the proxy? I suppose even if the >list is not used any more, ev