Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-02-10 Thread Al Boldi
Andreas Dilger wrote: > On Jan 26, 2008 08:27 +0300, Al Boldi wrote: > > Jan Kara wrote: > > > > data=ordered mode has proven reliable over the years, and it does > > > > this by ordering filedata flushes before metadata flushes. But this > > > > sometimes causes contention in the order of a 10x

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-02-06 Thread Andreas Dilger
On Jan 26, 2008 08:27 +0300, Al Boldi wrote: > Jan Kara wrote: > > > data=ordered mode has proven reliable over the years, and it does this > > > by ordering filedata flushes before metadata flushes. But this > > > sometimes causes contention in the order of a 10x slowdown for certain > > > apps,

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-02-05 Thread Al Boldi
Jan Kara wrote: > On Tue 05-02-08 10:07:44, Al Boldi wrote: > > Jan Kara wrote: > > > On Sat 02-02-08 00:26:00, Al Boldi wrote: > > > > Chris Mason wrote: > > > > > Al, could you please compare the write throughput from vmstat for > > > > > the data=ordered vs data=writeback runs? I would guess th

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-02-05 Thread Jan Kara
On Tue 05-02-08 10:07:44, Al Boldi wrote: > Jan Kara wrote: > > On Sat 02-02-08 00:26:00, Al Boldi wrote: > > > Chris Mason wrote: > > > > Al, could you please compare the write throughput from vmstat for the > > > > data=ordered vs data=writeback runs? I would guess the data=ordered > > > > one h

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-02-04 Thread Al Boldi
Jan Kara wrote: > On Sat 02-02-08 00:26:00, Al Boldi wrote: > > Chris Mason wrote: > > > Al, could you please compare the write throughput from vmstat for the > > > data=ordered vs data=writeback runs? I would guess the data=ordered > > > one has a lower overall write throughput. > > > > That's wh

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-02-04 Thread Jan Kara
On Sat 02-02-08 00:26:00, Al Boldi wrote: > Chris Mason wrote: > > On Thursday 31 January 2008, Jan Kara wrote: > > > On Thu 31-01-08 11:56:01, Chris Mason wrote: > > > > On Thursday 31 January 2008, Al Boldi wrote: > > > > > The big difference between ordered and writeback is that once the > > > >

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-02-01 Thread Al Boldi
Chris Mason wrote: > On Thursday 31 January 2008, Jan Kara wrote: > > On Thu 31-01-08 11:56:01, Chris Mason wrote: > > > On Thursday 31 January 2008, Al Boldi wrote: > > > > The big difference between ordered and writeback is that once the > > > > slowdown starts, ordered goes into ~100% iowait, wh

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-31 Thread Chris Mason
On Thursday 31 January 2008, Jan Kara wrote: > On Thu 31-01-08 11:56:01, Chris Mason wrote: > > On Thursday 31 January 2008, Al Boldi wrote: > > > Andreas Dilger wrote: > > > > On Wednesday 30 January 2008, Al Boldi wrote: > > > > > And, a quick test of successive 1sec delayed syncs shows no hangs

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-31 Thread Jan Kara
On Thu 31-01-08 11:56:01, Chris Mason wrote: > On Thursday 31 January 2008, Al Boldi wrote: > > Andreas Dilger wrote: > > > On Wednesday 30 January 2008, Al Boldi wrote: > > > > And, a quick test of successive 1sec delayed syncs shows no hangs until > > > > about 1 minute (~180mb) of db-writeout ac

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-31 Thread Chris Mason
On Thursday 31 January 2008, Al Boldi wrote: > Andreas Dilger wrote: > > On Wednesday 30 January 2008, Al Boldi wrote: > > > And, a quick test of successive 1sec delayed syncs shows no hangs until > > > about 1 minute (~180mb) of db-writeout activity, when the sync abruptly > > > hangs for minutes

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-30 Thread Al Boldi
Andreas Dilger wrote: > On Wednesday 30 January 2008, Al Boldi wrote: > > And, a quick test of successive 1sec delayed syncs shows no hangs until > > about 1 minute (~180mb) of db-writeout activity, when the sync abruptly > > hangs for minutes on end, and io-wait shows almost 100%. > > How large is

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-30 Thread Andreas Dilger
On Wednesday 30 January 2008, Al Boldi wrote: > And, a quick test of successive 1sec delayed syncs shows no hangs until > about 1 minute (~180mb) of db-writeout activity, when the sync abruptly > hangs for minutes on end, and io-wait shows almost 100%. How large is the journal in this filesystem?

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-30 Thread Al Boldi
Chris Mason wrote: > On Wednesday 30 January 2008, Al Boldi wrote: > > Jan Kara wrote: > > > > Chris Snook wrote: > > > > > Al Boldi wrote: > > > > > > This RFC proposes to introduce a tunable which allows to disable > > > > > > fsync and changes ordered into writeback writeout on a > > > > > > per

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-30 Thread Chris Mason
On Wednesday 30 January 2008, Al Boldi wrote: > Jan Kara wrote: > > > Chris Snook wrote: > > > > Al Boldi wrote: > > > > > This RFC proposes to introduce a tunable which allows to disable > > > > > fsync and changes ordered into writeback writeout on a per-process > > > > > basis like this: > > > >

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-29 Thread Al Boldi
Jan Kara wrote: > > Chris Snook wrote: > > > Al Boldi wrote: > > > > This RFC proposes to introduce a tunable which allows to disable > > > > fsync and changes ordered into writeback writeout on a per-process > > > > basis like this: > > > > > > > > echo 1 > /proc/`pidof process`/softsync > >

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-29 Thread Jan Kara
> Chris Snook wrote: > > Al Boldi wrote: > > > Greetings! > > > > > > data=ordered mode has proven reliable over the years, and it does this > > > by ordering filedata flushes before metadata flushes. But this > > > sometimes causes contention in the order of a 10x slowdown for certain > > > apps,

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-28 Thread Al Boldi
Jan Kara wrote: > On Sat 26-01-08 08:27:59, Al Boldi wrote: > > Do you mean there is a locking problem? > > No, but if you write to an mmaped file, then we can find out only later > we have dirty data in pages and we call writepage() on behalf of e.g. > pdflush(). Ok, that's a special case, whic

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-28 Thread Jan Kara
On Sat 26-01-08 08:27:43, Al Boldi wrote: > Diego Calleja wrote: > > El Thu, 24 Jan 2008 23:36:00 +0300, Al Boldi <[EMAIL PROTECTED]> escribió: > > > Greetings! > > > > > > data=ordered mode has proven reliable over the years, and it does this > > > by ordering filedata flushes before metadata flus

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-28 Thread Jan Kara
On Sat 26-01-08 08:27:59, Al Boldi wrote: > Jan Kara wrote: > > > Greetings! > > > > > > data=ordered mode has proven reliable over the years, and it does this > > > by ordering filedata flushes before metadata flushes. But this > > > sometimes causes contention in the order of a 10x slowdown for

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-25 Thread Al Boldi
Chris Snook wrote: > Al Boldi wrote: > > Greetings! > > > > data=ordered mode has proven reliable over the years, and it does this > > by ordering filedata flushes before metadata flushes. But this > > sometimes causes contention in the order of a 10x slowdown for certain > > apps, either due to t

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-25 Thread Al Boldi
Jan Kara wrote: > > Greetings! > > > > data=ordered mode has proven reliable over the years, and it does this > > by ordering filedata flushes before metadata flushes. But this > > sometimes causes contention in the order of a 10x slowdown for certain > > apps, either due to the misuse of fsync or

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-25 Thread Al Boldi
[EMAIL PROTECTED] wrote: > On Thu, 24 Jan 2008 23:36:00 +0300, Al Boldi said: > > This RFC proposes to introduce a tunable which allows to disable fsync > > and changes ordered into writeback writeout on a per-process basis like > > this: : : > But if you want to give them enough rope to shoot them

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-25 Thread Al Boldi
Diego Calleja wrote: > El Thu, 24 Jan 2008 23:36:00 +0300, Al Boldi <[EMAIL PROTECTED]> escribió: > > Greetings! > > > > data=ordered mode has proven reliable over the years, and it does this > > by ordering filedata flushes before metadata flushes. But this > > sometimes causes contention in the

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-25 Thread david
On Thu, 24 Jan 2008, Andreas Dilger wrote: On Jan 24, 2008 23:36 +0300, Al Boldi wrote: data=ordered mode has proven reliable over the years, and it does this by ordering filedata flushes before metadata flushes. But this sometimes causes contention in the order of a 10x slowdown for certain

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-25 Thread Andreas Dilger
On Jan 24, 2008 23:36 +0300, Al Boldi wrote: > data=ordered mode has proven reliable over the years, and it does this by > ordering filedata flushes before metadata flushes. But this sometimes > causes contention in the order of a 10x slowdown for certain apps, either > due to the misuse of fs

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-25 Thread Jan Kara
> Greetings! > > data=ordered mode has proven reliable over the years, and it does this by > ordering filedata flushes before metadata flushes. But this sometimes > causes contention in the order of a 10x slowdown for certain apps, either > due to the misuse of fsync or due to inherent behavio

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-24 Thread Chris Snook
Al Boldi wrote: Greetings! data=ordered mode has proven reliable over the years, and it does this by ordering filedata flushes before metadata flushes. But this sometimes causes contention in the order of a 10x slowdown for certain apps, either due to the misuse of fsync or due to inherent b

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-24 Thread Valdis . Kletnieks
On Thu, 24 Jan 2008 23:36:00 +0300, Al Boldi said: > data=ordered mode has proven reliable over the years, and it does this by > ordering filedata flushes before metadata flushes. But this sometimes > causes contention in the order of a 10x slowdown for certain apps, either > due to the misuse

Re: [RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-24 Thread Diego Calleja
El Thu, 24 Jan 2008 23:36:00 +0300, Al Boldi <[EMAIL PROTECTED]> escribió: > Greetings! > > data=ordered mode has proven reliable over the years, and it does this by > ordering filedata flushes before metadata flushes. But this sometimes > causes contention in the order of a 10x slowdown for c

[RFC] ext3: per-process soft-syncing data=ordered mode

2008-01-24 Thread Al Boldi
Greetings! data=ordered mode has proven reliable over the years, and it does this by ordering filedata flushes before metadata flushes. But this sometimes causes contention in the order of a 10x slowdown for certain apps, either due to the misuse of fsync or due to inherent behaviour like db's