logging problems - "Pipe Shut"

2007-07-03 Thread Gaute Amundsen
Hi again. We have had logging running for about a week now with no apparent problems, but yesterday I routed all our traffic into varnish, and now bad things happen. /var/log/varnish/varnish.log just stops growing after a while and a tail -n 1 gives me pages after pages of: Pipe Shut write(r

Re: logging problems - "Pipe Shut"

2007-07-03 Thread Dag-Erling Smørgrav
Gaute Amundsen <[EMAIL PROTECTED]> writes: > We have had logging running for about a week now with no apparent > problems, but yesterday I routed all our traffic into varnish, and now > bad things happen. > > /var/log/varnish/varnish.log just stops growing after a while and a > tail -n 1 gives me p

Re: logging problems - "Pipe Shut"

2007-07-03 Thread Gaute Amundsen
On Tuesday 03 July 2007 15:18, Dag-Erling Smørgrav wrote: > Gaute Amundsen <[EMAIL PROTECTED]> writes: > > We have had logging running for about a week now with no apparent > > problems, but yesterday I routed all our traffic into varnish, and now > > bad things happen. > > > > /var/log/varnish/var

Re: logging problems - "Pipe Shut"

2007-07-03 Thread Gaute Amundsen
Hm.. I was finding quite a bit of "Pipe Shut" just running varnishlog -o. I's out of my buffer, so I cant paste it in right now, but could it bee that I was opening to many pipes? I the default action in vcl_recv was pipe, and only a few hosts would get a lookup... Trying with pass now, and it

Re: logging problems - "Pipe Shut"

2007-07-03 Thread Dag-Erling Smørgrav
Gaute Amundsen <[EMAIL PROTECTED]> writes: > Rotation is weekly, and the previous logs have sane dates. Weekly rotation is probably far too seldom, Varnish can easily generate several gigabytes of log data *per hour* under high load. Have you checked the file size limit (ulimit -f) that varnishlo

Re: logging problems - "Pipe Shut"

2007-07-03 Thread Dag-Erling Smørgrav
Gaute Amundsen <[EMAIL PROTECTED]> writes: > I was finding quite a bit of "Pipe Shut" just running varnishlog -o. > I's out of my buffer, so I cant paste it in right now, but could it > bee that I was opening to many pipes? "pipe shut" happens when either the backend or the client closes the conne

Re: logging problems - "Pipe Shut"

2007-07-03 Thread Gaute Amundsen
On Tuesday 03 July 2007 16:05, Dag-Erling Smørgrav wrote: > Gaute Amundsen <[EMAIL PROTECTED]> writes: > > Rotation is weekly, and the previous logs have sane dates. > > Weekly rotation is probably far too seldom, Varnish can easily generate > several gigabytes of log data *per hour* under high loa

Re: logging problems - "Pipe Shut"

2007-07-03 Thread Dag-Erling Smørgrav
Gaute Amundsen <[EMAIL PROTECTED]> writes: > On Tuesday 03 July 2007 16:05, Dag-Erling Smørgrav wrote: > > Gaute Amundsen <[EMAIL PROTECTED]> writes: > > > Rotation is weekly, and the previous logs have sane dates. > > Weekly rotation is probably far too seldom, Varnish can easily generate > > seve

Re: logging problems - "Pipe Shut"

2007-07-03 Thread Gaute Amundsen
On Tuesday 03 July 2007 16:30, Dag-Erling Smørgrav wrote: > varnishncsa shouldn't care, as it processes the log file linearly, but I > generally prefer to rotate by size. Hm.. ok. But that would have me running awstats at odd times.. Wil just have to try it out I guess > Is this a 32-bit machine

Re: logging problems - "Pipe Shut"

2007-07-04 Thread Dag-Erling Smørgrav
Gaute Amundsen <[EMAIL PROTECTED]> writes: > On Tuesday 03 July 2007 16:30, Dag-Erling Smørgrav wrote: > > Is this a 32-bit machine, BTW? > It is. Quad Xeon 3 GHz. Ah, OK, you won't be able to process log files larger than about 2 GB on a 32-bit machine. I should probably figure out a way to get

Re: logging problems - "Pipe Shut"

2007-07-04 Thread Gaute Amundsen
On Wednesday 04 July 2007 09:47, Dag-Erling Smørgrav wrote: > Gaute Amundsen <[EMAIL PROTECTED]> writes: > > On Tuesday 03 July 2007 16:30, Dag-Erling Smørgrav wrote: > > > Is this a 32-bit machine, BTW? > > > > It is. Quad Xeon 3 GHz. > > Ah, OK, you won't be able to process log files larger than

Re: logging problems - "Pipe Shut"

2007-07-05 Thread Gaute Amundsen
> Ah, OK, you won't be able to process log files larger than about 2 GB on > a 32-bit machine. I should probably figure out a way to get around > that. Ok, now I have set up /var/log/varnish/varnish.log to rotate every hour, and a postrotate action on that to pipe through varnishncsa and append

Re: logging problems - "Pipe Shut"

2007-07-05 Thread Dag-Erling Smørgrav
Gaute Amundsen <[EMAIL PROTECTED]> writes: > I made a small script to run varnish(log|ncsa) on every file and get > the returnstatus. log works fine, and a tail of that diplays sensible > output and timestamps, but ncsa segfaults on about half of them. No > pattern discernible.. Can you send me o

Re: logging problems - "Pipe Shut"

2007-07-05 Thread Gaute Amundsen
That did the trick for the processing :-D Only the logging itself left then. With som luck logger restarts on logrotate every hour will keep that stable til 1.1 is out :-) Gaute On Thursday 05 July 2007 20:20, Gaute Amundsen wrote: > On Thursday 05 July 2007 17:18, Dag-Erling Smørgrav wrote: >