Re: cache empties itself?

2008-04-07 Thread DHF
Ricardo Newbery wrote:
> On Apr 7, 2008, at 5:22 PM, Michael S. Fischer wrote:
>
>   
>> Sure, but this is also the sort of content that can be cached back
>> upstream using ordinary HTTP headers.
>> 
>
>
> No, it cannot.  Again, the use case is dynamically-generated content  
> that is subject to change at unpredictable intervals but which is  
> otherwise fairly "static" for some length of time, and where serving  
> stale content after a change is unacceptable.  "Ordinary" HTTP headers  
> just don't solve that use case without unnecessary loading of the  
> backend.
>   
Isn't this what if-modified-since requests are for?  304 not modified is 
a pretty small request/response, though I can understand the tendency to 
want to push it out to the frontend caches.  I would think the 
management overhead of maintaining two seperate expirations wouldn't be 
worth the extra hassle just to save yourself some ims requests to a 
backend.  Unless of course varnish doesn't support ims requests in a 
usable way, I haven't actually tested it myself.

--Dave
___
varnish-misc mailing list
varnish-misc@projects.linpro.no
http://projects.linpro.no/mailman/listinfo/varnish-misc


Re: cache empties itself?

2008-04-07 Thread Ricardo Newbery

On Apr 7, 2008, at 5:22 PM, Michael S. Fischer wrote:

> On Fri, Apr 4, 2008 at 3:31 PM, Ricardo Newbery <[EMAIL PROTECTED] 
> > wrote:
>
 Again, "static" content isn't only the stuff that is served from
 filesystems in the classic static web server scenario.  There are  
 plenty
>> of
 "dynamic" applications that process content from database --  
 applying
>> skins
 and compositing multiple elements into a single page while  
 filtering
>> every
 element or otherwise applying special processing based on a user's
>> access
 privileges.  An example of this is a dynamic content management  
 system
>> like
 Plone or Drupal.  In many cases, these "dynamic" responses are  
 fairly
 "static" for some period of time but there is still a definite
>> performance
 hit, especially under load
>
>> In any case, both of these examples, Plone and Drupal, can indeed  
>> cache the
>> output "locally" but that is still not as fast as placing a  
>> dedicated cache
>> server in front.  It's almost always faster to have a dedicated
>> single-purpose process do something instead of cranking up the hefty
>> machinery for requests that can be adequately served by the lighter  
>> process.
>
> Sure, but this is also the sort of content that can be cached back
> upstream using ordinary HTTP headers.


No, it cannot.  Again, the use case is dynamically-generated content  
that is subject to change at unpredictable intervals but which is  
otherwise fairly "static" for some length of time, and where serving  
stale content after a change is unacceptable.  "Ordinary" HTTP headers  
just don't solve that use case without unnecessary loading of the  
backend.


> Still waiting for that compelling case that requires independent cache
> configuration,


This is an odd response.  I've already pointed out at least one common  
use case which can benefit from "independent" cache configuration.  Is  
that not compelling enough?  It might help if you can explain your  
criteria for what qualifies as "compelling".

Ric







___
varnish-misc mailing list
varnish-misc@projects.linpro.no
http://projects.linpro.no/mailman/listinfo/varnish-misc


Re: cache empties itself?

2008-04-07 Thread Michael S. Fischer
On Fri, Apr 4, 2008 at 3:31 PM, Ricardo Newbery <[EMAIL PROTECTED]> wrote:

> > > Again, "static" content isn't only the stuff that is served from
> > > filesystems in the classic static web server scenario.  There are plenty
> of
> > > "dynamic" applications that process content from database -- applying
> skins
> > > and compositing multiple elements into a single page while filtering
> every
> > > element or otherwise applying special processing based on a user's
> access
> > > privileges.  An example of this is a dynamic content management system
> like
> > > Plone or Drupal.  In many cases, these "dynamic" responses are fairly
> > > "static" for some period of time but there is still a definite
> performance
> > > hit, especially under load

>  In any case, both of these examples, Plone and Drupal, can indeed cache the
> output "locally" but that is still not as fast as placing a dedicated cache
> server in front.  It's almost always faster to have a dedicated
> single-purpose process do something instead of cranking up the hefty
> machinery for requests that can be adequately served by the lighter process.

Sure, but this is also the sort of content that can be cached back
upstream using ordinary HTTP headers.

Still waiting for that compelling case that requires independent cache
configuration,

--Michael
___
varnish-misc mailing list
varnish-misc@projects.linpro.no
http://projects.linpro.no/mailman/listinfo/varnish-misc


Varnish config/performance with Domino Webmail

2008-04-07 Thread MARCELO LICASTRO PAGNI
Hi everyone,

I am setting up a new server that will sit into a DMZ to serve as a reverse
proxy for our company's Lotus Domino webmail. Having heard about Varnish, my
choice couldn't be something else.

I've set it up with the default configuration, but its performance showed to
be very, very poor. I've tried some tweaks to the VCL config file, but it
did not change. Performance is twice, tree times worst than directly
accesing the original server.

Machine is a HP server DL320 G5p, Xeon dual-core 2,66Ghz, 2GB RAM.

I would appreciate some directions on what to do.

Thank you,
Marcelo L.

ps. below is my changed VCL config file:

backend default {
set backend.host = "172.16.251.2";
set backend.port = "80";
}


sub vcl_recv {
if (req.request == "GET" && req.http.cookie) {
lookup;
}
}

sub vcl_fetch {
if (obj.http.Set-Cookie) {
insert;
}
}

sub vcl_fetch {
if (obj.ttl < 120s) {
set obj.ttl = 120s;
}
}

sub vcl_fetch {
remove obj.http.Set-Cookie;
}

sub vcl_recv {
 if (req.request == "GET" && req.url ~ "\.(gif|jpg|swf|css|js).*") {
lookup;
 }
}
___
varnish-misc mailing list
varnish-misc@projects.linpro.no
http://projects.linpro.no/mailman/listinfo/varnish-misc


Re: recommendation for swap space?

2008-04-07 Thread Simon Lyall
On Mon, 7 Apr 2008, Michael S. Fischer wrote:
> On Mon, Apr 7, 2008 at 2:14 PM, Simon Lyall <[EMAIL PROTECTED]> wrote:
> > On Mon, 7 Apr 2008, Michael S. Fischer wrote:
> >  > That said, it wouldn't make sense to entirely deallocate your swap
> >  > space, since the kernel may decide to page or swap out processes other
> >  > than Varnish.
> >
> >  and what is wrong with that?  Surely your RAM is better being used by the
> >  main applications on the server ( Varnish ) rather than "sitting around
> >  and waiting" copies of sshd, cron and getty?
>
> Huh?  Nothing I said contradicts that.

Sorry, I read " wouldn't " as " would " [1] .


[1] Approx 7 times.

-- 
Simon J. Lyall  |  Very Busy  |  Web: http://www.darkmere.gen.nz/
"To stay awake all night adds a day to your life" - Stilgar | eMT.

___
varnish-misc mailing list
varnish-misc@projects.linpro.no
http://projects.linpro.no/mailman/listinfo/varnish-misc


Re: recommendation for swap space?

2008-04-07 Thread Michael S. Fischer
On Mon, Apr 7, 2008 at 2:14 PM, Simon Lyall <[EMAIL PROTECTED]> wrote:
> On Mon, 7 Apr 2008, Michael S. Fischer wrote:
>  > That said, it wouldn't make sense to entirely deallocate your swap
>  > space, since the kernel may decide to page or swap out processes other
>  > than Varnish.
>
>  and what is wrong with that?  Surely your RAM is better being used by the
>  main applications on the server ( Varnish ) rather than "sitting around
>  and waiting" copies of sshd, cron and getty?

Huh?  Nothing I said contradicts that.

--Michael
___
varnish-misc mailing list
varnish-misc@projects.linpro.no
http://projects.linpro.no/mailman/listinfo/varnish-misc


Re: recommendation for swap space?

2008-04-07 Thread Simon Lyall
On Mon, 7 Apr 2008, Michael S. Fischer wrote:
> That said, it wouldn't make sense to entirely deallocate your swap
> space, since the kernel may decide to page or swap out processes other
> than Varnish.



and what is wrong with that?  Surely your RAM is better being used by the
main applications on the server ( Varnish ) rather than "sitting around
and waiting" copies of sshd, cron and getty?



-- 
Simon J. Lyall  |  Very Busy  |  Web: http://www.darkmere.gen.nz/
"To stay awake all night adds a day to your life" - Stilgar | eMT.

___
varnish-misc mailing list
varnish-misc@projects.linpro.no
http://projects.linpro.no/mailman/listinfo/varnish-misc


Multiple backends - Restarts - 1.1.2

2008-04-07 Thread Alex Davies
Hi,

I've just sucessfully configured Varnish 1.1.2.

I have two webservers with identical content. If both servers are
working, I do not care if the traffic is set to only one or to both.
However, as and when one dies, I would like varnish to send traffic
only to the working one!

I notice the "Using restarts to try multiple backends" [1] in the
Wiki, but it does not work for me. Even configuring more than one
backend prevents varnish from starting. I've searched the mailing
lists and there are references to this feature only being available in
"trunk" versions.

Does anyone have any information on when a branch that is stableish is
likely to appear from this trunk?

Many thanks,

Alex

[1] http://varnish.projects.linpro.no/wiki/VCLExampleRestarts
___
varnish-misc mailing list
varnish-misc@projects.linpro.no
http://projects.linpro.no/mailman/listinfo/varnish-misc


Re: Management console

2008-04-07 Thread Dag-Erling Smørgrav
<[EMAIL PROTECTED]> writes:
> Is it possible to use a password when connection the the management
> console?

Not currently.  It wouldn't make much difference anyway, since the
connection is unencrypted.  I have plans to add support for binding the
management interface to a Unix socket instead of a TCP socket, which
will prevent sniffing and allow you to restrict access using regular
file system permissions.

> Why is it wierd line-breaks when connecting from windows telnet/putty
> telnet to varnish management console?

Because you didn't set it up to perform the required LF -> CR LF
translation.

DES
-- 
Dag-Erling Smørgrav
Senior Software Developer
Linpro AS - www.linpro.no
___
varnish-misc mailing list
varnish-misc@projects.linpro.no
http://projects.linpro.no/mailman/listinfo/varnish-misc


Re: recommendation for swap space?

2008-04-07 Thread Michael S. Fischer
On Mon, Apr 7, 2008 at 9:00 AM, Dag-Erling Smørgrav <[EMAIL PROTECTED]> wrote:
> Sascha Ottolski <[EMAIL PROTECTED]> writes:
>  > now that my varnish processes start to reach the RAM size, I'm wondering
>  > what a dimension of swap would be wise? I currently have about 30 GB
>  > swap space for 32 GB RAM, but am wondering if it could even make sense
>  > to have no swap at all? My cache file is 517 GB in size.
>
>  Varnish does not use swap.

That said, it wouldn't make sense to entirely deallocate your swap
space, since the kernel may decide to page or swap out processes other
than Varnish.

--Michael
___
varnish-misc mailing list
varnish-misc@projects.linpro.no
http://projects.linpro.no/mailman/listinfo/varnish-misc


Re: recommendation for swap space?

2008-04-07 Thread Dag-Erling Smørgrav
Sascha Ottolski <[EMAIL PROTECTED]> writes:
> now that my varnish processes start to reach the RAM size, I'm wondering 
> what a dimension of swap would be wise? I currently have about 30 GB 
> swap space for 32 GB RAM, but am wondering if it could even make sense 
> to have no swap at all? My cache file is 517 GB in size.

Varnish does not use swap.

DES
-- 
Dag-Erling Smørgrav
Senior Software Developer
Linpro AS - www.linpro.no
___
varnish-misc mailing list
varnish-misc@projects.linpro.no
http://projects.linpro.no/mailman/listinfo/varnish-misc


Management console

2008-04-07 Thread duja
Is it possible to use a password when connection the the management console?

Why is it wierd line-breaks when connecting from windows telnet/putty telnet to 
varnish management console?

Looks like this:
discard 
vcl.list
vcl.show 
 param.show [-l] []
  param.
set  
   url.purge 
 hash.purge 

Thanks
Erik

___
varnish-misc mailing list
varnish-misc@projects.linpro.no
http://projects.linpro.no/mailman/listinfo/varnish-misc