Re: scsi vs ide performance on fsync's

2001-03-12 Thread Andre Hedrick
On Wed, 7 Mar 2001, Stephen C. Tweedie wrote: > Hi, > > On Tue, Mar 06, 2001 at 10:44:34AM -0800, Linus Torvalds wrote: > > > On Tue, 6 Mar 2001, Alan Cox wrote: > > > You want a write barrier. Write buffering (at least for short intervals) in > > > the drive is very sensible. The kernel needs

Re: scsi vs ide performance on fsync's

2001-03-12 Thread Andre Hedrick
On Wed, 7 Mar 2001, Stephen C. Tweedie wrote: Hi, On Tue, Mar 06, 2001 at 10:44:34AM -0800, Linus Torvalds wrote: On Tue, 6 Mar 2001, Alan Cox wrote: You want a write barrier. Write buffering (at least for short intervals) in the drive is very sensible. The kernel needs to able to

Re: scsi vs ide performance on fsync's

2001-03-09 Thread Matthias Urlichs
Hi, Jens Axboe: > > But most disks these days support IDE-SCSI, and SCSI does have ordered > > tags, so... > > Any proof to back this up? To my knowledge, only some WDC ATA disks > can be ATAPI driven. > Ummm, no, but that was my impression. If that's wrong, I apologize and will state the

Re: scsi vs ide performance on fsync's

2001-03-09 Thread Jens Axboe
On Fri, Mar 09 2001, Matthias Urlichs wrote: > Matthias Urlichs: > > On Wed, Mar 07 2001, Stephen C. Tweedie wrote: > > > SCSI certainly lets us do both of these operations independently. IDE > > > has the sync/flush command afaik, but I'm not sure whether the IDE > > > tagged command stuff has

Re: scsi vs ide performance on fsync's

2001-03-09 Thread Jonathan Morton
>> It's pretty clear that the IDE drive(r) is *not* waiting for the physical >> write to take place before returning control to the user program, whereas >> the SCSI drive(r) is. > >This would not be unexpected. > >IDE drives generally always do write buffering. I don't even know if you >_can_

Re: scsi vs ide performance on fsync's

2001-03-09 Thread Jonathan Morton
It's pretty clear that the IDE drive(r) is *not* waiting for the physical write to take place before returning control to the user program, whereas the SCSI drive(r) is. This would not be unexpected. IDE drives generally always do write buffering. I don't even know if you _can_ turn it off.

Re: scsi vs ide performance on fsync's

2001-03-09 Thread Jens Axboe
On Fri, Mar 09 2001, Matthias Urlichs wrote: Matthias Urlichs: On Wed, Mar 07 2001, Stephen C. Tweedie wrote: SCSI certainly lets us do both of these operations independently. IDE has the sync/flush command afaik, but I'm not sure whether the IDE tagged command stuff has the

Re: scsi vs ide performance on fsync's

2001-03-09 Thread Matthias Urlichs
Hi, Jens Axboe: But most disks these days support IDE-SCSI, and SCSI does have ordered tags, so... Any proof to back this up? To my knowledge, only some WDC ATA disks can be ATAPI driven. Ummm, no, but that was my impression. If that's wrong, I apologize and will state the opposite,

Re: scsi vs ide performance on fsync's

2001-03-08 Thread Matthias Urlichs
Hi, Matthias Urlichs: > On Wed, Mar 07 2001, Stephen C. Tweedie wrote: > > SCSI certainly lets us do both of these operations independently. IDE > > has the sync/flush command afaik, but I'm not sure whether the IDE > > tagged command stuff has the equivalent of SCSI's ordered tag bits. > >

Re: scsi vs ide performance on fsync's

2001-03-08 Thread Chris Mason
On Wednesday, March 07, 2001 08:56:59 PM + "Stephen C. Tweedie" <[EMAIL PROTECTED]> wrote: > Hi, > > On Wed, Mar 07, 2001 at 09:15:36PM +0100, Jens Axboe wrote: >> On Wed, Mar 07 2001, Stephen C. Tweedie wrote: >> > >> > For most fs'es, that's not an issue. The fs won't start writeback

Re: scsi vs ide performance on fsync's

2001-03-08 Thread Stephen C. Tweedie
Hi, On Wed, Mar 07, 2001 at 10:36:38AM -0800, Linus Torvalds wrote: > On Wed, 7 Mar 2001, Jeremy Hansen wrote: > > > > So in the meantime as this gets worked out on a lower level, we've decided > > to take the fsync() out of berkeley db for mysql transaction logs and > > mount the filesystem -o

Re: scsi vs ide performance on fsync's

2001-03-08 Thread Pavel Machek
Hi! > If not, then the drive could by all means optimise the access pattern > provided it acked the data or provided the results in the same order as the > instructions were given. This would probably shorten the time for a new > pathological set (distributed evenly across the disk surface, but

Re: scsi vs ide performance on fsync's

2001-03-08 Thread Pavel Machek
Hi! If not, then the drive could by all means optimise the access pattern provided it acked the data or provided the results in the same order as the instructions were given. This would probably shorten the time for a new pathological set (distributed evenly across the disk surface, but all

Re: scsi vs ide performance on fsync's

2001-03-08 Thread Stephen C. Tweedie
Hi, On Wed, Mar 07, 2001 at 10:36:38AM -0800, Linus Torvalds wrote: On Wed, 7 Mar 2001, Jeremy Hansen wrote: So in the meantime as this gets worked out on a lower level, we've decided to take the fsync() out of berkeley db for mysql transaction logs and mount the filesystem -o sync.

Re: scsi vs ide performance on fsync's

2001-03-08 Thread Chris Mason
On Wednesday, March 07, 2001 08:56:59 PM + "Stephen C. Tweedie" [EMAIL PROTECTED] wrote: Hi, On Wed, Mar 07, 2001 at 09:15:36PM +0100, Jens Axboe wrote: On Wed, Mar 07 2001, Stephen C. Tweedie wrote: For most fs'es, that's not an issue. The fs won't start writeback on the

Re: scsi vs ide performance on fsync's

2001-03-08 Thread Matthias Urlichs
Hi, Matthias Urlichs: On Wed, Mar 07 2001, Stephen C. Tweedie wrote: SCSI certainly lets us do both of these operations independently. IDE has the sync/flush command afaik, but I'm not sure whether the IDE tagged command stuff has the equivalent of SCSI's ordered tag bits. Andre?

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Jens Axboe
On Wed, Mar 07 2001, Stephen C. Tweedie wrote: > On Wed, Mar 07, 2001 at 09:15:36PM +0100, Jens Axboe wrote: > > On Wed, Mar 07 2001, Stephen C. Tweedie wrote: > > > > > > For most fs'es, that's not an issue. The fs won't start writeback on > > > the primary disk at all until the journal commit

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Stephen C. Tweedie
Hi, On Wed, Mar 07, 2001 at 09:15:36PM +0100, Jens Axboe wrote: > On Wed, Mar 07 2001, Stephen C. Tweedie wrote: > > > > For most fs'es, that's not an issue. The fs won't start writeback on > > the primary disk at all until the journal commit has been acknowledged > > as firm on disk. > > But

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Jens Axboe
On Wed, Mar 07 2001, Stephen C. Tweedie wrote: > On Wed, Mar 07, 2001 at 07:51:52PM +0100, Jens Axboe wrote: > > On Wed, Mar 07 2001, Stephen C. Tweedie wrote: > > > > My bigger concern is when the journalled fs has a log on a different > > queue. > > For most fs'es, that's not an issue. The

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Stephen C. Tweedie
Hi, On Wed, Mar 07, 2001 at 07:51:52PM +0100, Jens Axboe wrote: > On Wed, Mar 07 2001, Stephen C. Tweedie wrote: > > My bigger concern is when the journalled fs has a log on a different > queue. For most fs'es, that's not an issue. The fs won't start writeback on the primary disk at all until

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Jens Axboe
On Wed, Mar 07 2001, Stephen C. Tweedie wrote: > > Yep, it's much harder than it seems. Especially because for the barrier > > to be really useful, having inter-request dependencies becomes a > > requirement. So you can say something like 'flush X and Y, but don't > > flush Y before X is done'. >

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Stephen C. Tweedie
Hi, On Wed, Mar 07, 2001 at 03:12:41PM +0100, Jens Axboe wrote: > > Yep, it's much harder than it seems. Especially because for the barrier > to be really useful, having inter-request dependencies becomes a > requirement. So you can say something like 'flush X and Y, but don't > flush Y before

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Linus Torvalds
On Wed, 7 Mar 2001, Jeremy Hansen wrote: > > So in the meantime as this gets worked out on a lower level, we've decided > to take the fsync() out of berkeley db for mysql transaction logs and > mount the filesystem -o sync. > > Can anyone perhaps tell me why this may be a bad idea? Two

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Jeremy Hansen
1-676-2355 > > - Original Message - > > From: "Andre Hedrick" <[EMAIL PROTECTED]> > > To: "Linus Torvalds" <[EMAIL PROTECTED]> > > Cc: "Douglas Gilbert" <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]> > > Sent:

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Jens Axboe
On Wed, Mar 07 2001, Stephen C. Tweedie wrote: > SCSI certainly lets us do both of these operations independently. IDE > has the sync/flush command afaik, but I'm not sure whether the IDE > tagged command stuff has the equivalent of SCSI's ordered tag bits. > Andre? IDE has no concept of

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Jens Axboe
On Wed, Mar 07 2001, Stephen C. Tweedie wrote: > > SCSI has ordered tag, which fit the model Alan described quite nicely. > > I've been meaning to implement this for some time, it would be handy > > for journalled fs to use such a barrier. Since ATA doesn't do queueing > > (at least not in

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Stephen C. Tweedie
Hi, On Tue, Mar 06, 2001 at 09:37:20PM +0100, Jens Axboe wrote: > > SCSI has ordered tag, which fit the model Alan described quite nicely. > I've been meaning to implement this for some time, it would be handy > for journalled fs to use such a barrier. Since ATA doesn't do queueing > (at least

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Stephen C. Tweedie
Hi, On Tue, Mar 06, 2001 at 10:44:34AM -0800, Linus Torvalds wrote: > On Tue, 6 Mar 2001, Alan Cox wrote: > > You want a write barrier. Write buffering (at least for short intervals) in > > the drive is very sensible. The kernel needs to able to send drivers a write > > barrier which will not

Re: scsi vs ide performance on fsync's

2001-03-07 Thread David Balazic
Andre Hedrick ([EMAIL PROTECTED]) wrote on Wed Mar 07 2001 - 01:58:44 EST : > On Wed, 7 Mar 2001, Jonathan Morton wrote: [ snip ] > > >Since all OSes that enable WC at init will flush > > >it at shutdown and do a periodic purge with in-activity. > > > > But Linux doesn't, as has been

Re: scsi vs ide performance on fsync's

2001-03-07 Thread David Balazic
Andre Hedrick ([EMAIL PROTECTED]) wrote on Wed Mar 07 2001 - 01:58:44 EST : On Wed, 7 Mar 2001, Jonathan Morton wrote: [ snip ] Since all OSes that enable WC at init will flush it at shutdown and do a periodic purge with in-activity. But Linux doesn't, as has been pointed out

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Stephen C. Tweedie
Hi, On Tue, Mar 06, 2001 at 10:44:34AM -0800, Linus Torvalds wrote: On Tue, 6 Mar 2001, Alan Cox wrote: You want a write barrier. Write buffering (at least for short intervals) in the drive is very sensible. The kernel needs to able to send drivers a write barrier which will not be

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Jens Axboe
On Wed, Mar 07 2001, Stephen C. Tweedie wrote: SCSI has ordered tag, which fit the model Alan described quite nicely. I've been meaning to implement this for some time, it would be handy for journalled fs to use such a barrier. Since ATA doesn't do queueing (at least not in current

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Jens Axboe
On Wed, Mar 07 2001, Stephen C. Tweedie wrote: SCSI certainly lets us do both of these operations independently. IDE has the sync/flush command afaik, but I'm not sure whether the IDE tagged command stuff has the equivalent of SCSI's ordered tag bits. Andre? IDE has no concept of ordered

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Jeremy Hansen
- Original Message - From: "Andre Hedrick" [EMAIL PROTECTED] To: "Linus Torvalds" [EMAIL PROTECTED] Cc: "Douglas Gilbert" [EMAIL PROTECTED]; [EMAIL PROTECTED] Sent: Tuesday, March 06, 2001 2:12 AM Subject: Re: scsi vs ide performance on fsync's On Mon, 5

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Stephen C. Tweedie
Hi, On Wed, Mar 07, 2001 at 03:12:41PM +0100, Jens Axboe wrote: Yep, it's much harder than it seems. Especially because for the barrier to be really useful, having inter-request dependencies becomes a requirement. So you can say something like 'flush X and Y, but don't flush Y before X is

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Stephen C. Tweedie
Hi, On Wed, Mar 07, 2001 at 07:51:52PM +0100, Jens Axboe wrote: On Wed, Mar 07 2001, Stephen C. Tweedie wrote: My bigger concern is when the journalled fs has a log on a different queue. For most fs'es, that's not an issue. The fs won't start writeback on the primary disk at all until the

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Jens Axboe
On Wed, Mar 07 2001, Stephen C. Tweedie wrote: On Wed, Mar 07, 2001 at 07:51:52PM +0100, Jens Axboe wrote: On Wed, Mar 07 2001, Stephen C. Tweedie wrote: My bigger concern is when the journalled fs has a log on a different queue. For most fs'es, that's not an issue. The fs won't

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Stephen C. Tweedie
Hi, On Wed, Mar 07, 2001 at 09:15:36PM +0100, Jens Axboe wrote: On Wed, Mar 07 2001, Stephen C. Tweedie wrote: For most fs'es, that's not an issue. The fs won't start writeback on the primary disk at all until the journal commit has been acknowledged as firm on disk. But do you

Re: scsi vs ide performance on fsync's

2001-03-07 Thread Jens Axboe
On Wed, Mar 07 2001, Stephen C. Tweedie wrote: On Wed, Mar 07, 2001 at 09:15:36PM +0100, Jens Axboe wrote: On Wed, Mar 07 2001, Stephen C. Tweedie wrote: For most fs'es, that's not an issue. The fs won't start writeback on the primary disk at all until the journal commit has been

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Andre Hedrick
On Wed, 7 Mar 2001, Jonathan Morton wrote: > Still doesn't make a difference - there is one revolution between writes, > no matter where on disk it is. Oh it does, because you are hitting the same sector with the same data. Rotate your buffer and then you will see the difference. > >Because of

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Jonathan Morton
>I am not going to bite on your flame bate, and are free to waste you money. I don't flamebait. I was trying to clear up some confusion... >No, SCSI does with queuing. >I am saying that the ata/ide driver rips the heart out of the >io_request_lock what to darn long. This means that upon

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Mark Hahn
> itself is a bad thing, particularly given the amount of CPU overhead that > IDE drives demand while attached to the controller (orders of magnitude > higher than a good SCSI controller) - the more overhead we can hand off to I know this is just a troll by a scsi-believer, but I'm biting

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Jens Axboe
On Tue, Mar 06 2001, David Balazic wrote: > > > Wrong model > > > > > > You want a write barrier. Write buffering (at least for short intervals) > > > in the drive is very sensible. The kernel needs to able to send > > > drivers a write barrier which will not be completed with outstanding > > >

Re: scsi vs ide performance on fsync's

2001-03-06 Thread David Balazic
Linus Torvalds himself wrote : > On Tue, 6 Mar 2001, Alan Cox wrote: > > > > > > I don't know if there is any way to turn of a write buffer on an IDE disk. > > > You want a forced set of commands to kill caching at init? > > > > Wrong model > > > > You want a write barrier. Write

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Andre Hedrick
Jonathan, I am not going to bite on your flame bate, and are free to waste you money. On Tue, 6 Mar 2001, Jonathan Morton wrote: > >> It's pretty clear that the IDE drive(r) is *not* waiting for the physical > >> write to take place before returning control to the user program, whereas > >>

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Linus Torvalds
On Tue, 6 Mar 2001, Alan Cox wrote: > > > > I don't know if there is any way to turn of a write buffer on an IDE disk. > > You want a forced set of commands to kill caching at init? > > Wrong model > > You want a write barrier. Write buffering (at least for short intervals) in > the drive is

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Jonathan Morton
>Jonathan Morton ([EMAIL PROTECTED]) wrote : > >> The OS needs to know the physical act of writing data has finished >>before >> it tells the m/board to cut the power - period. Pathological data sets >> included - they are the worst case which every engineer must take into >> account. Out of

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Gregory Maxwell
On Tue, Mar 06, 2001 at 06:14:15PM +0100, David Balazic wrote: [snip] > Hardware Level caching is only good for OSes which have broken > drivers and broken caching (like plain old DOS). > > Linux does a good job in caching and cache control at software > level. Read caching, yes. But for

Re: scsi vs ide performance on fsync's

2001-03-06 Thread David Balazic
(( please CC me , not subscribed , [EMAIL PROTECTED] ) Jonathan Morton ([EMAIL PROTECTED]) wrote : > The OS needs to know the physical act of writing data has finished before > it tells the m/board to cut the power - period. Pathological data sets > included - they are the worst case

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Jonathan Morton
>On Tue, 6 Mar 2001, Mike Black wrote: > >> Write caching is the culprit for the performance diff: Indeed, and my during-the-boring-lecture benchmark on my 18Gb IBM TravelStar bears this out. I was confused earlier by the fact that one of my Seagate drives blatently ignores the no-write-caching

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Jeremy Hansen
ns > http://www.csihq.com/~mike My home page > FAX 321-676-2355 > - Original Message - > From: "Andre Hedrick" <[EMAIL PROTECTED]> > To: "Linus Torvalds" <[EMAIL PROTECTED]> > Cc: "Douglas Gilbert" <[EMAIL PROTECTED]>; <

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Jonathan Morton
>> Pathological shutdown pattern: assuming scatter-gather is not allowed (for >> IDE), and a 20ms full-stroke seek, write sectors at alternately opposite >> ends of the disk, working inwards until the buffer is full. 512-byte >> sectors, 2MB of them, is 4000 writes * 20ms = around 80 seconds

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Mike Black
ot; <[EMAIL PROTECTED]> Cc: "Douglas Gilbert" <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]> Sent: Tuesday, March 06, 2001 2:12 AM Subject: Re: scsi vs ide performance on fsync's On Mon, 5 Mar 2001, Linus Torvalds wrote: > Well, it's fairly hard for the kernel to do much

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Jonathan Morton
>> i assume you meant to time the xlog.c program? (or did i miss another >> program on the thread?) Yes. >> i've an IBM-DJSA-210 (travelstar 10GB, 5411rpm) which appears to do >> *something* with the write cache flag -- it gets 0.10s elapsed real time >> in default config; and gets 2.91s if i

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Rik van Riel
On Tue, 6 Mar 2001, Jonathan Morton wrote: > Pathological shutdown pattern: assuming scatter-gather is not allowed (for > IDE), and a 20ms full-stroke seek, write sectors at alternately opposite > ends of the disk, working inwards until the buffer is full. 512-byte > sectors, 2MB of them, is

Re: scsi vs ide performance on fsync's

2001-03-06 Thread dean gaudet
On Tue, 6 Mar 2001, dean gaudet wrote: > i assume you meant to time the xlog.c program? (or did i miss another > program on the thread?) > > i've an IBM-DJSA-210 (travelstar 10GB, 5411rpm) which appears to do > *something* with the write cache flag -- it gets 0.10s elapsed real time > in

Re: scsi vs ide performance on fsync's

2001-03-06 Thread dean gaudet
On Tue, 6 Mar 2001, Jonathan Morton wrote: > Pathological shutdown pattern: assuming scatter-gather is not allowed > (for IDE), and a 20ms full-stroke seek, write sectors at alternately > opposite ends of the disk, working inwards until the buffer is full. > 512-byte sectors, 2MB of them, is

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Alan Cox
> > I don't know if there is any way to turn of a write buffer on an IDE disk. > You want a forced set of commands to kill caching at init? Wrong model You want a write barrier. Write buffering (at least for short intervals) in the drive is very sensible. The kernel needs to able to send

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Jonathan Morton
>> It's pretty clear that the IDE drive(r) is *not* waiting for the physical >> write to take place before returning control to the user program, whereas >> the SCSI drive(r) is. Both devices appear to be performing the write > >Wrong, IDE does not unplug thus the request is almost, I hate to

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Jonathan Morton
It's pretty clear that the IDE drive(r) is *not* waiting for the physical write to take place before returning control to the user program, whereas the SCSI drive(r) is. Both devices appear to be performing the write Wrong, IDE does not unplug thus the request is almost, I hate to admit it

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Alan Cox
I don't know if there is any way to turn of a write buffer on an IDE disk. You want a forced set of commands to kill caching at init? Wrong model You want a write barrier. Write buffering (at least for short intervals) in the drive is very sensible. The kernel needs to able to send drivers a

Re: scsi vs ide performance on fsync's

2001-03-06 Thread dean gaudet
On Tue, 6 Mar 2001, Jonathan Morton wrote: Pathological shutdown pattern: assuming scatter-gather is not allowed (for IDE), and a 20ms full-stroke seek, write sectors at alternately opposite ends of the disk, working inwards until the buffer is full. 512-byte sectors, 2MB of them, is 4000

Re: scsi vs ide performance on fsync's

2001-03-06 Thread dean gaudet
On Tue, 6 Mar 2001, dean gaudet wrote: i assume you meant to time the xlog.c program? (or did i miss another program on the thread?) i've an IBM-DJSA-210 (travelstar 10GB, 5411rpm) which appears to do *something* with the write cache flag -- it gets 0.10s elapsed real time in default

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Rik van Riel
On Tue, 6 Mar 2001, Jonathan Morton wrote: Pathological shutdown pattern: assuming scatter-gather is not allowed (for IDE), and a 20ms full-stroke seek, write sectors at alternately opposite ends of the disk, working inwards until the buffer is full. 512-byte sectors, 2MB of them, is 4000

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Jonathan Morton
i assume you meant to time the xlog.c program? (or did i miss another program on the thread?) Yes. i've an IBM-DJSA-210 (travelstar 10GB, 5411rpm) which appears to do *something* with the write cache flag -- it gets 0.10s elapsed real time in default config; and gets 2.91s if i do "hdparm

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Mike Black
TECTED] Cc: "Douglas Gilbert" [EMAIL PROTECTED]; [EMAIL PROTECTED] Sent: Tuesday, March 06, 2001 2:12 AM Subject: Re: scsi vs ide performance on fsync's On Mon, 5 Mar 2001, Linus Torvalds wrote: Well, it's fairly hard for the kernel to do much about that - it's almost certainly

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Jonathan Morton
Pathological shutdown pattern: assuming scatter-gather is not allowed (for IDE), and a 20ms full-stroke seek, write sectors at alternately opposite ends of the disk, working inwards until the buffer is full. 512-byte sectors, 2MB of them, is 4000 writes * 20ms = around 80 seconds (not

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Jeremy Hansen
Andre Hedrick" [EMAIL PROTECTED] To: "Linus Torvalds" [EMAIL PROTECTED] Cc: "Douglas Gilbert" [EMAIL PROTECTED]; [EMAIL PROTECTED] Sent: Tuesday, March 06, 2001 2:12 AM Subject: Re: scsi vs ide performance on fsync's On Mon, 5 Mar 2001, Linus Torvalds wrote: Well, i

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Jonathan Morton
On Tue, 6 Mar 2001, Mike Black wrote: Write caching is the culprit for the performance diff: Indeed, and my during-the-boring-lecture benchmark on my 18Gb IBM TravelStar bears this out. I was confused earlier by the fact that one of my Seagate drives blatently ignores the no-write-caching

Re: scsi vs ide performance on fsync's

2001-03-06 Thread David Balazic
(( please CC me , not subscribed , [EMAIL PROTECTED] ) Jonathan Morton ([EMAIL PROTECTED]) wrote : The OS needs to know the physical act of writing data has finished before it tells the m/board to cut the power - period. Pathological data sets included - they are the worst case

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Gregory Maxwell
On Tue, Mar 06, 2001 at 06:14:15PM +0100, David Balazic wrote: [snip] Hardware Level caching is only good for OSes which have broken drivers and broken caching (like plain old DOS). Linux does a good job in caching and cache control at software level. Read caching, yes. But for writes, the

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Jonathan Morton
Jonathan Morton ([EMAIL PROTECTED]) wrote : The OS needs to know the physical act of writing data has finished before it tells the m/board to cut the power - period. Pathological data sets included - they are the worst case which every engineer must take into account. Out of interest, does

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Linus Torvalds
On Tue, 6 Mar 2001, Alan Cox wrote: I don't know if there is any way to turn of a write buffer on an IDE disk. You want a forced set of commands to kill caching at init? Wrong model You want a write barrier. Write buffering (at least for short intervals) in the drive is very

Re: scsi vs ide performance on fsync's

2001-03-06 Thread David Balazic
Linus Torvalds himself wrote : On Tue, 6 Mar 2001, Alan Cox wrote: I don't know if there is any way to turn of a write buffer on an IDE disk. You want a forced set of commands to kill caching at init? Wrong model You want a write barrier. Write buffering (at least for

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Andre Hedrick
Jonathan, I am not going to bite on your flame bate, and are free to waste you money. On Tue, 6 Mar 2001, Jonathan Morton wrote: It's pretty clear that the IDE drive(r) is *not* waiting for the physical write to take place before returning control to the user program, whereas the SCSI

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Jens Axboe
On Tue, Mar 06 2001, David Balazic wrote: Wrong model You want a write barrier. Write buffering (at least for short intervals) in the drive is very sensible. The kernel needs to able to send drivers a write barrier which will not be completed with outstanding commands before

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Mark Hahn
itself is a bad thing, particularly given the amount of CPU overhead that IDE drives demand while attached to the controller (orders of magnitude higher than a good SCSI controller) - the more overhead we can hand off to I know this is just a troll by a scsi-believer, but I'm biting anyway.

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Jonathan Morton
I am not going to bite on your flame bate, and are free to waste you money. I don't flamebait. I was trying to clear up some confusion... No, SCSI does with queuing. I am saying that the ata/ide driver rips the heart out of the io_request_lock what to darn long. This means that upon execution

Re: scsi vs ide performance on fsync's

2001-03-06 Thread Andre Hedrick
On Wed, 7 Mar 2001, Jonathan Morton wrote: Still doesn't make a difference - there is one revolution between writes, no matter where on disk it is. Oh it does, because you are hitting the same sector with the same data. Rotate your buffer and then you will see the difference. Because of

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Andre Hedrick
On Mon, 5 Mar 2001, Linus Torvalds wrote: > Well, it's fairly hard for the kernel to do much about that - it's almost > certainly just IDE doing write buffering on the disk itself. No OS > involved. I am pushing for WC to be defaulted in the off state, but as you know I have a bigger fight than

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Andre Hedrick
On Tue, 6 Mar 2001, Jonathan Morton wrote: > It's pretty clear that the IDE drive(r) is *not* waiting for the physical > write to take place before returning control to the user program, whereas > the SCSI drive(r) is. Both devices appear to be performing the write Wrong, IDE does not unplug

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Jonathan Morton
>I don't know if there is any way to turn of a write buffer on an IDE disk. hdparm has an option of this nature, but it makes no difference (as I reported). It's worth noting that even turning off UDMA to the disk on my machine doesn't help the situation - although it does slow things down a

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Linus Torvalds
On Tue, 6 Mar 2001, Douglas Gilbert wrote: > > > On the other hand, it's also entirely possible that IDE is just a lot > > better than what the SCSI-bigots tend to claim. It's not all that > > surprising, considering that the PC industry has pushed untold billions of > > dollars into improving

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Douglas Gilbert
Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Linus Torvalds wrote: > Well, it's entirely possible that the mid-level SCSI layer is doing > something horribly stupid. Well it's in good company as FreeBSD 4.2 on the same hardware returns the same result

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Linus Torvalds
On Tue, 6 Mar 2001, Jonathan Morton wrote: > > It's pretty clear that the IDE drive(r) is *not* waiting for the physical > write to take place before returning control to the user program, whereas > the SCSI drive(r) is. This would not be unexpected. IDE drives generally always do write

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Jonathan Morton
I've run the test on my own system and noted something interesting about the results: When the write() call extended the file (rather than just overwriting a section of a file already long enough), the performance drop was seen, and it was slower on SCSI than IDE - this is independent of whether

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Linus Torvalds
On Mon, 5 Mar 2001, Jeremy Hansen wrote: > > Right now I'm running 2.4.2-ac11 on both machines and getting the same > results: > > SCSI: > > [root@orville /root]# time /root/xlog file.out fsync > > real0m21.266s > user0m0.000s > sys 0m0.310s > > IDE: > > [root@kahlbi /root]#

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Jeremy Hansen
On 2 Mar 2001, Linus Torvalds wrote: > In article <[EMAIL PROTECTED]>, > Jeremy Hansen <[EMAIL PROTECTED]> wrote: > > > >The SCSI adapter on the raid array is an Adaptec 39160, the raid > >controller is a CMD-7040. Kernel 2.4.0 using XFS for the filesystem on > >the raid array, kernel 2.2.18

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Douglas Gilbert
Since the intention of fsync and fdatasync seems to be to write dirty fs buffers to persistent storage (i.e. the "oxide") then the best time is not necessarily the objective. Given the IDE times that people have been reporting, it is very unlikely that any of those IDE disks were really doing

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Andi Kleen
Chris Mason <[EMAIL PROTECTED]> writes: > filemap_fdatawait, filemap_fdatasync, and fsync_inode_buffers all restrict > their scans to a list of dirty buffers for that specific file. Only > file_fsync goes through all the dirty buffers on the device, and the ext2 > fsync path never calls

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Andi Kleen
Chris Mason [EMAIL PROTECTED] writes: filemap_fdatawait, filemap_fdatasync, and fsync_inode_buffers all restrict their scans to a list of dirty buffers for that specific file. Only file_fsync goes through all the dirty buffers on the device, and the ext2 fsync path never calls file_fsync.

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Jonathan Morton
I've run the test on my own system and noted something interesting about the results: When the write() call extended the file (rather than just overwriting a section of a file already long enough), the performance drop was seen, and it was slower on SCSI than IDE - this is independent of whether

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Douglas Gilbert
Since the intention of fsync and fdatasync seems to be to write dirty fs buffers to persistent storage (i.e. the "oxide") then the best time is not necessarily the objective. Given the IDE times that people have been reporting, it is very unlikely that any of those IDE disks were really doing

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Linus Torvalds
On Tue, 6 Mar 2001, Jonathan Morton wrote: It's pretty clear that the IDE drive(r) is *not* waiting for the physical write to take place before returning control to the user program, whereas the SCSI drive(r) is. This would not be unexpected. IDE drives generally always do write

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Douglas Gilbert
Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Linus Torvalds wrote: Well, it's entirely possible that the mid-level SCSI layer is doing something horribly stupid. Well it's in good company as FreeBSD 4.2 on the same hardware returns the same result

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Linus Torvalds
On Tue, 6 Mar 2001, Douglas Gilbert wrote: On the other hand, it's also entirely possible that IDE is just a lot better than what the SCSI-bigots tend to claim. It's not all that surprising, considering that the PC industry has pushed untold billions of dollars into improving IDE,

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Jonathan Morton
I don't know if there is any way to turn of a write buffer on an IDE disk. hdparm has an option of this nature, but it makes no difference (as I reported). It's worth noting that even turning off UDMA to the disk on my machine doesn't help the situation - although it does slow things down a

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Andre Hedrick
On Tue, 6 Mar 2001, Jonathan Morton wrote: It's pretty clear that the IDE drive(r) is *not* waiting for the physical write to take place before returning control to the user program, whereas the SCSI drive(r) is. Both devices appear to be performing the write Wrong, IDE does not unplug thus

Re: scsi vs ide performance on fsync's

2001-03-05 Thread Andre Hedrick
On Mon, 5 Mar 2001, Linus Torvalds wrote: Well, it's fairly hard for the kernel to do much about that - it's almost certainly just IDE doing write buffering on the disk itself. No OS involved. I am pushing for WC to be defaulted in the off state, but as you know I have a bigger fight than

Re: scsi vs ide performance on fsync's

2001-03-04 Thread Ishikawa
Douglas Gilbert wrote: > There is definitely something strange going on here. > As the bonnie test below shows, the SCSI disk used > for my tests should vastly outperform the old IDE one: First thank you and others with my clueless investigation about the module loading under Debian GNU/Linux.

  1   2   >