Re: spindown [was Re: 2.4.6-pre2, pre3 VM Behavior]

2001-06-18 Thread Mike Galbraith
On Mon, 18 Jun 2001, Daniel Phillips wrote: > On Sunday 17 June 2001 12:05, Mike Galbraith wrote: > > It _juuust_ so happens that I was tinkering... what do you think of > > something like the below? (and boy do I ever wonder what a certain > > box doing slrn stuff thinks of it.. hint hint;) > >

Re: spindown [was Re: 2.4.6-pre2, pre3 VM Behavior]

2001-06-18 Thread Daniel Phillips
On Sunday 17 June 2001 12:05, Mike Galbraith wrote: > It _juuust_ so happens that I was tinkering... what do you think of > something like the below? (and boy do I ever wonder what a certain > box doing slrn stuff thinks of it.. hint hint;) It's too subtle for me ;-) (Not shy about sying that b

Re: (lkml)Re: spindown [was Re: 2.4.6-pre2, pre3 VM Behavior]

2001-06-17 Thread Mike Galbraith
On Sun, 17 Jun 2001 [EMAIL PROTECTED] wrote: > On Sun, Jun 17, 2001 at 12:05:10PM +0200, Mike Galbraith wrote: > > > > It _juuust_ so happens that I was tinkering... what do you think of > > something like the below? (and boy do I ever wonder what a certain > > box doing slrn stuff thinks of it.

Re: (lkml)Re: spindown [was Re: 2.4.6-pre2, pre3 VM Behavior]

2001-06-17 Thread thunder7
On Sun, Jun 17, 2001 at 12:05:10PM +0200, Mike Galbraith wrote: > > It _juuust_ so happens that I was tinkering... what do you think of > something like the below? (and boy do I ever wonder what a certain > box doing slrn stuff thinks of it.. hint hint;) > I'm sorry to say this box doesn't real

Re: spindown [was Re: 2.4.6-pre2, pre3 VM Behavior]

2001-06-17 Thread Daniel Phillips
On Saturday 16 June 2001 23:54, Rik van Riel wrote: > On Sat, 16 Jun 2001, Daniel Phillips wrote: > > > Does the patch below do anything good for your laptop? ;) > > > > I'll wait for the next one ;-) > > OK, here's one which isn't reversed and should work ;)) > > --- fs/buffer.c.orig Sat Jun 16

Re: spindown [was Re: 2.4.6-pre2, pre3 VM Behavior]

2001-06-17 Thread Mike Galbraith
On Sat, 16 Jun 2001, Daniel Phillips wrote: > On Saturday 16 June 2001 23:06, Rik van Riel wrote: > > On Sat, 16 Jun 2001, Daniel Phillips wrote: > > > As a side note, the good old multisecond delay before bdflush kicks in > > > doesn't really make a lot of sense - when bandwidth is available the

Re: spindown [was Re: 2.4.6-pre2, pre3 VM Behavior]

2001-06-16 Thread Rik van Riel
On Sat, 16 Jun 2001, Daniel Phillips wrote: > > Does the patch below do anything good for your laptop? ;) > > I'll wait for the next one ;-) OK, here's one which isn't reversed and should work ;)) --- fs/buffer.c.origSat Jun 16 18:05:29 2001 +++ fs/buffer.c Sat Jun 16 18:05:15 2001 @@ -255

Re: spindown [was Re: 2.4.6-pre2, pre3 VM Behavior]

2001-06-16 Thread Daniel Phillips
On Saturday 16 June 2001 23:06, Rik van Riel wrote: > On Sat, 16 Jun 2001, Daniel Phillips wrote: > > As a side note, the good old multisecond delay before bdflush kicks in > > doesn't really make a lot of sense - when bandwidth is available the > > filesystem-initiated writeouts should happen rig

Re: spindown [was Re: 2.4.6-pre2, pre3 VM Behavior]

2001-06-16 Thread Rik van Riel
On Sat, 16 Jun 2001, Rik van Riel wrote: Oops, I did something stupid and the patch is reversed ;) > --- buffer.c.orig Sat Jun 16 18:05:15 2001 > +++ buffer.c Sat Jun 16 18:05:29 2001 > @@ -2550,8 +2550,7 @@ > if the current bh is not yet timed out, >

Re: spindown [was Re: 2.4.6-pre2, pre3 VM Behavior]

2001-06-16 Thread Rik van Riel
On Sat, 16 Jun 2001, Daniel Phillips wrote: > In other words, any episode of pageouts is followed immediately by a > short episode of preemptive cleaning. linux/mm/vmscan.c::page_launder(), around line 666: /* Let bdflush take care of the rest. */ wakeup_bdflush(0

Re: spindown [was Re: 2.4.6-pre2, pre3 VM Behavior]

2001-06-16 Thread Daniel Phillips
On Friday 15 June 2001 17:23, Pavel Machek wrote: > Hi! > > > Roger> It does if you are running on a laptop. Then you do not want > > Roger> the pages go out all the time. Disk has gone too sleep, needs > > Roger> to start to write a few pages, stays idle for a while, goes to > > Roger> sleep, a f

spindown [was Re: 2.4.6-pre2, pre3 VM Behavior]

2001-06-16 Thread Pavel Machek
Hi! > Roger> It does if you are running on a laptop. Then you do not want > Roger> the pages go out all the time. Disk has gone too sleep, needs > Roger> to start to write a few pages, stays idle for a while, goes to > Roger> sleep, a few more pages, ... > > That could be handled by a metric whi

Re: 2.4.6-pre2, pre3 VM Behavior

2001-06-15 Thread Helge Hafting
Mark Hahn wrote: > > Disk speed is difficult. I may enable and disable swap on any number of > ... > > You may be able to get some useful approximations, but you > > will probably not be able to get good numbers in all cases. > > a useful approximation would be simply an idle flag. > for instan

Re: 2.4.6-pre2, pre3 VM Behavior

2001-06-14 Thread Mike Galbraith
On Thu, 14 Jun 2001, Roger Larsson wrote: > On Thursday 14 June 2001 10:47, Daniel Phillips wrote: > > On Thursday 14 June 2001 05:16, Rik van Riel wrote: > > > On Wed, 13 Jun 2001, Tom Sightler wrote: > > > > Quoting Rik van Riel <[EMAIL PROTECTED]>: > > > > > After the initial burst, the system

Re: 2.4.6-pre2, pre3 VM Behavior

2001-06-14 Thread Rik van Riel
On Thu, 14 Jun 2001, John Stoffel wrote: > Rik> There's another issue. If dirty data is written out in small > Rik> bunches, that means we have to write out the dirty data more > Rik> often. > > What do you consider a small bunch? 32k? 1Mb? 1% of buffer space? > I don't see how delaying write

Re: 2.4.6-pre2, pre3 VM Behavior

2001-06-14 Thread John Stoffel
Rik> There's another issue. If dirty data is written out in small Rik> bunches, that means we have to write out the dirty data more Rik> often. What do you consider a small bunch? 32k? 1Mb? 1% of buffer space? I don't see how delaying writes until the buffer is almost full really helps us.

Re: 2.4.6-pre2, pre3 VM Behavior

2001-06-14 Thread Rik van Riel
On Thu, 14 Jun 2001, John Stoffel wrote: > That could be handled by a metric which says if the disk is spun down, > wait until there is more memory pressure before writing. But if the > disk is spinning, we don't care, you should start writing out buffers > at some low rate to keep the pressure

Re: 2.4.6-pre2, pre3 VM Behavior

2001-06-14 Thread John Stoffel
Roger> It does if you are running on a laptop. Then you do not want Roger> the pages go out all the time. Disk has gone too sleep, needs Roger> to start to write a few pages, stays idle for a while, goes to Roger> sleep, a few more pages, ... That could be handled by a metric which says if the d

Re: 2.4.6-pre2, pre3 VM Behavior

2001-06-14 Thread Roger Larsson
On Thursday 14 June 2001 10:47, Daniel Phillips wrote: > On Thursday 14 June 2001 05:16, Rik van Riel wrote: > > On Wed, 13 Jun 2001, Tom Sightler wrote: > > > Quoting Rik van Riel <[EMAIL PROTECTED]>: > > > > After the initial burst, the system should stabilise, > > > > starting the writeout of p

Re: 2.4.6-pre2, pre3 VM Behavior

2001-06-14 Thread Daniel Phillips
On Thursday 14 June 2001 17:10, John Stoffel wrote: > >> The file _could_ be a temporary file, which gets removed before > >> we'd get around to writing it to disk. Sure, the chances of this > >> happening with a single file are close to zero, but having 100MB > >> from 200 different temp files on

Re: 2.4.6-pre2, pre3 VM Behavior

2001-06-14 Thread Mark Hahn
> > Would it be possible to maintain a dirty-rate count > > for the dirty buffers? > > > > For example, we it is possible to figure an approximate > > disk subsystem speed from most of the given information. > > Disk speed is difficult. I may enable and disable swap on any number of ... > You m

Re: 2.4.6-pre2, pre3 VM Behavior

2001-06-14 Thread John Stoffel
>> The file _could_ be a temporary file, which gets removed before >> we'd get around to writing it to disk. Sure, the chances of this >> happening with a single file are close to zero, but having 100MB >> from 200 different temp files on a shell server isn't unreasonable >> to expect. Daniel> T

Re: 2.4.6-pre2, pre3 VM Behavior

2001-06-14 Thread Helge Hafting
Laramie Leavitt wrote: > Would it be possible to maintain a dirty-rate count > for the dirty buffers? > > For example, we it is possible to figure an approximate > disk subsystem speed from most of the given information. Disk speed is difficult. I may enable and disable swap on any number of v

Re: 2.4.6-pre2, pre3 VM Behavior

2001-06-14 Thread Daniel Phillips
On Thursday 14 June 2001 05:16, Rik van Riel wrote: > On Wed, 13 Jun 2001, Tom Sightler wrote: > > Quoting Rik van Riel <[EMAIL PROTECTED]>: > > > After the initial burst, the system should stabilise, > > > starting the writeout of pages before we run low on > > > memory. How to handle the initial

Re: 2.4.6-pre2, pre3 VM Behavior

2001-06-14 Thread Mike Galbraith
On Wed, 13 Jun 2001, Rik van Riel wrote: > On Wed, 13 Jun 2001, Tom Sightler wrote: > > > 1. Transfer of the first 100-150MB is very fast (9.8MB/sec via 100Mb Ethernet, > > close to wire speed). At this point Linux has yet to write the first byte to > > disk. OK, this might be an exaggerated,

RE: 2.4.6-pre2, pre3 VM Behavior

2001-06-14 Thread Laramie Leavitt
On Behalf Of Rik van Riel > On Wed, 13 Jun 2001, Tom Sightler wrote: > > Quoting Rik van Riel <[EMAIL PROTECTED]>: > > > > > After the initial burst, the system should stabilise, > > > starting the writeout of pages before we run low on > > > memory. How to handle the initial burst is something >

Re: 2.4.6-pre2, pre3 VM Behavior

2001-06-13 Thread Rik van Riel
On Wed, 13 Jun 2001, Tom Sightler wrote: > Quoting Rik van Riel <[EMAIL PROTECTED]>: > > > After the initial burst, the system should stabilise, > > starting the writeout of pages before we run low on > > memory. How to handle the initial burst is something > > I haven't figured out yet ... ;) >

Re: 2.4.6-pre2, pre3 VM Behavior

2001-06-13 Thread Tom Sightler
Quoting Mark Hahn <[EMAIL PROTECTED]>: > > 1. Transfer of the first 100-150MB is very fast (9.8MB/sec via 100Mb > Ethernet, > > close to wire speed). At this point Linux has yet to write the first > byte to > > disk. OK, this might be an exaggerated, but very little disk activity > has > > occ

Re: 2.4.6-pre2, pre3 VM Behavior

2001-06-13 Thread Tom Sightler
Quoting Rik van Riel <[EMAIL PROTECTED]>: > After the initial burst, the system should stabilise, > starting the writeout of pages before we run low on > memory. How to handle the initial burst is something > I haven't figured out yet ... ;) Well, at least I know that this is expected with the V

Re: 2.4.6-pre2, pre3 VM Behavior

2001-06-13 Thread Rik van Riel
On Wed, 13 Jun 2001, Tom Sightler wrote: > 1. Transfer of the first 100-150MB is very fast (9.8MB/sec via 100Mb Ethernet, > close to wire speed). At this point Linux has yet to write the first byte to > disk. OK, this might be an exaggerated, but very little disk activity has > occured on my l