Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-27 Thread Eric Sandeen
Andrew Morton wrote: > On Wed, 13 Sep 2006 15:25:19 -0500 > Dave Kleikamp <[EMAIL PROTECTED]> wrote: > >>> +void journal_do_submit_data(struct buffer_head **wbuf, int bufs) >> Is there any reason this couldn't be static? > > Nope. With this change, journal_brelse_array can also be made static in

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-13 Thread Andrew Morton
On Wed, 13 Sep 2006 15:25:19 -0500 Dave Kleikamp <[EMAIL PROTECTED]> wrote: > > +void journal_do_submit_data(struct buffer_head **wbuf, int bufs) > > Is there any reason this couldn't be static? Nope. > > +{ > > + int i; > > + > > + for (i = 0; i < bufs; i++) { > > + w

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-13 Thread Dave Kleikamp
On Fri, 2006-09-08 at 00:30 +0200, Jan Kara wrote: > diff -rupX /home/jack/.kerndiffexclude > linux-2.6.18-rc6/fs/jbd/commit.c > linux-2.6.18-rc6-1-orderedwrite/fs/jbd/commit.c > --- linux-2.6.18-rc6/fs/jbd/commit.c2006-09-06 18:20:48.0 > +0200 > +++ linux-2.6.18-rc6-1-orderedwrite/fs/j

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-11 Thread Jan Kara
> On Mon, 2006-09-11 at 11:46 +0200, Jan Kara wrote: > ... > > > > > > I don't have any performance tests handy. We have some automated tests I > > > can schedule to run to verify the stability aspects. > > OK. I've run IOZONE rewrite throughput test on my computer with > > iozone -t 10 -i 0 -s

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-11 Thread Badari Pulavarty
On Mon, 2006-09-11 at 11:46 +0200, Jan Kara wrote: ... > > > > I don't have any performance tests handy. We have some automated tests I > > can schedule to run to verify the stability aspects. > OK. I've run IOZONE rewrite throughput test on my computer with > iozone -t 10 -i 0 -s 10M -e > 2.

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-11 Thread Jan Kara
Hi, > >>>Original commit code assumes, that when a buffer on BJ_SyncData list is > >>>locked, > >>>it is being written to disk. But this is not true and hence it can lead > >>>to a > >>>potential data loss on crash. Also the code didn't count with the fact > >>>that > >>>journal_dirty_data()

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-08 Thread Badari Pulavarty
Jan Kara wrote: Hi, Jan Kara wrote: I've been looking more at the code and I have revived my patch fixing this part of the code. I've mildly tested the patch. Could you also give it a try? Thanks. Honza -

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-08 Thread Jan Kara
Hi, > Jan Kara wrote: > > I've been looking more at the code and I have revived my patch fixing > >this part of the code. I've mildly tested the patch. Could you also give > >it a try? Thanks. > > > > Honza > > > >---

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-07 Thread Badari Pulavarty
Jan Kara wrote: Ugh! Are you sure? For this path the buffer must be attached (only) to the running transaction. But then how the commit code comes to it? Somebody would have to even manage to refile the buffer from the committing transaction to the running one while the buffer is in wbuf[]. Cou

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-07 Thread Jan Kara
> > > Ugh! Are you sure? For this path the buffer must be attached (only) to > > the running transaction. But then how the commit code comes to it? > > Somebody would have to even manage to refile the buffer from the > > committing transaction to the running one while the buffer is in wbuf[]. >

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-07 Thread Jan Kara
Hi, > > Ugh! Are you sure? For this path the buffer must be attached (only) to > > the running transaction. But then how the commit code comes to it? > > Somebody would have to even manage to refile the buffer from the > > committing transaction to the running one while the buffer is in wbuf[]

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-07 Thread Badari Pulavarty
> Ugh! Are you sure? For this path the buffer must be attached (only) to > the running transaction. But then how the commit code comes to it? > Somebody would have to even manage to refile the buffer from the > committing transaction to the running one while the buffer is in wbuf[]. > Could you

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-06 Thread Andrew Morton
On Wed, 06 Sep 2006 20:04:27 -0700 Badari Pulavarty <[EMAIL PROTECTED]> wrote: > > I've been unable to reproduce this crash, btw. Is there some magic > > incantation apat from running `fsx-linux'? > > > All I do is on a single 1k filesystem, run 4 copies of fsx (on 4 > different files, ofcour

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-06 Thread Badari Pulavarty
Andrew Morton wrote: On Wed, 6 Sep 2006 19:27:33 +0200 Jan Kara <[EMAIL PROTECTED]> wrote: Ugh! Are you sure? For this path the buffer must be attached (only) to the running transaction. But then how the commit code comes to it? Somebody would have to even manage to refile the buffer from

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-06 Thread Andrew Morton
On Wed, 6 Sep 2006 19:27:33 +0200 Jan Kara <[EMAIL PROTECTED]> wrote: > Ugh! Are you sure? For this path the buffer must be attached (only) to > the running transaction. But then how the commit code comes to it? > Somebody would have to even manage to refile the buffer from the > committing tran

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-06 Thread Jan Kara
> On Wed, 2006-09-06 at 18:27 +0200, Jan Kara wrote: > > > But my debug clearly shows that we are clearing the buffer, while > > > we haven't actually submitted to ll_rw_block() code. (I added "track" > > > flag to bh and set it in journal_commit_transaction() when we add > > > them to wbuf[] and c

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-06 Thread Badari Pulavarty
On Wed, 2006-09-06 at 18:27 +0200, Jan Kara wrote: > > On Wed, 2006-09-06 at 17:34 +0200, Jan Kara wrote: > > > > On Wed, 2006-09-06 at 14:47 +0200, Jan Kara wrote: > > > > > > > > > > Andrew, what should we do ? Do you suggest handling this in jbd > > > > > > itself (like this patch) ? > > > > >

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-06 Thread Jan Kara
> On Wed, 2006-09-06 at 18:27 +0200, Jan Kara wrote: > > > > > > But my debug clearly shows that we are clearing the buffer, while > > > we haven't actually submitted to ll_rw_block() code. (I added "track" > > > flag to bh and set it in journal_commit_transaction() when we add > > > them to wbuf[

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-06 Thread Badari Pulavarty
On Wed, 2006-09-06 at 18:27 +0200, Jan Kara wrote: > > On Wed, 2006-09-06 at 17:34 +0200, Jan Kara wrote: > > > > On Wed, 2006-09-06 at 14:47 +0200, Jan Kara wrote: > > > > > > > > > > Andrew, what should we do ? Do you suggest handling this in jbd > > > > > > itself (like this patch) ? > > > > >

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-06 Thread Jan Kara
> On Wed, 2006-09-06 at 17:34 +0200, Jan Kara wrote: > > > On Wed, 2006-09-06 at 14:47 +0200, Jan Kara wrote: > > > > > > > > Andrew, what should we do ? Do you suggest handling this in jbd > > > > > itself (like this patch) ? > > > > Actually that part of commit code needs rewrite anyway (and a

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-06 Thread Badari Pulavarty
On Wed, 2006-09-06 at 17:34 +0200, Jan Kara wrote: > > On Wed, 2006-09-06 at 14:47 +0200, Jan Kara wrote: > > > > > > Andrew, what should we do ? Do you suggest handling this in jbd > > > > itself (like this patch) ? > > > Actually that part of commit code needs rewrite anyway (and after that >

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-06 Thread Jan Kara
> On Wed, 2006-09-06 at 14:47 +0200, Jan Kara wrote: > > > > Andrew, what should we do ? Do you suggest handling this in jbd > > > itself (like this patch) ? > > Actually that part of commit code needs rewrite anyway (and after that > > rewrite you get rid of ll_rw_block()) because of other prob

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-06 Thread Badari Pulavarty
On Wed, 2006-09-06 at 14:47 +0200, Jan Kara wrote: > Hi, > > > On Fri, 2006-09-01 at 10:18 -0700, Andrew Morton wrote: > > > > > > Kernel BUG at fs/buffer.c:2791 > > > > > > invalid opcode: [1] SMP > > > > > > > > > > > > Its complaining about BUG_ON(!buffer_mapped(bh)). > > > > Here is t

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-06 Thread Jan Kara
Hi, > On Fri, 2006-09-01 at 10:18 -0700, Andrew Morton wrote: > > > > > Kernel BUG at fs/buffer.c:2791 > > > > > invalid opcode: [1] SMP > > > > > > > > > > Its complaining about BUG_ON(!buffer_mapped(bh)). > > Here is the change that seems to cause the problem. Jana Kara > introduced a n

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-05 Thread Badari Pulavarty
On Fri, 2006-09-01 at 10:18 -0700, Andrew Morton wrote: > On Fri, 01 Sep 2006 09:32:22 -0700 > Badari Pulavarty <[EMAIL PROTECTED]> wrote: > > > > > Kernel BUG at fs/buffer.c:2791 > > > > invalid opcode: [1] SMP > > > > > > > > Its complaining about BUG_ON(!buffer_mapped(bh)). > > I need to

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-01 Thread Badari Pulavarty
Andrew Morton wrote: On Fri, 01 Sep 2006 09:32:22 -0700 Badari Pulavarty <[EMAIL PROTECTED]> wrote: Kernel BUG at fs/buffer.c:2791 invalid opcode: [1] SMP Its complaining about BUG_ON(!buffer_mapped(bh)). I need to have a little think about this, remember what _should_ be ha

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-01 Thread Badari Pulavarty
On Fri, 2006-09-01 at 10:18 -0700, Andrew Morton wrote: > On Fri, 01 Sep 2006 09:32:22 -0700 > Badari Pulavarty <[EMAIL PROTECTED]> wrote: > > > > > Kernel BUG at fs/buffer.c:2791 > > > > invalid opcode: [1] SMP > > > > > > > > Its complaining about BUG_ON(!buffer_mapped(bh)). > > I need to

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-01 Thread Andrew Morton
On Fri, 01 Sep 2006 09:32:22 -0700 Badari Pulavarty <[EMAIL PROTECTED]> wrote: > > > Kernel BUG at fs/buffer.c:2791 > > > invalid opcode: [1] SMP > > > > > > Its complaining about BUG_ON(!buffer_mapped(bh)). I need to have a little think about this, remember what _should_ be happening in th

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-01 Thread Badari Pulavarty
On Fri, 2006-09-01 at 17:12 +0100, Anton Altaparmakov wrote: > Hi, > > On Fri, 1 Sep 2006, Badari Pulavarty wrote: > > > > I have been running into following bug while running fsx > > tests on 1k (ext3) filesystem all the time. > > > > --- [cut here ] - [please bite here ] -

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-01 Thread Anton Altaparmakov
Hi, On Fri, 1 Sep 2006, Badari Pulavarty wrote: > > I have been running into following bug while running fsx > tests on 1k (ext3) filesystem all the time. > > --- [cut here ] - [please bite here ] - > Kernel BUG at fs/buffer.c:2791 > invalid opcode: [1] SMP > > Its

[RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-01 Thread Badari Pulavarty
Hi Andrew, I have been running into following bug while running fsx tests on 1k (ext3) filesystem all the time. --- [cut here ] - [please bite here ] - Kernel BUG at fs/buffer.c:2791 invalid opcode: [1] SMP Its complaining about BUG_ON(!buffer_mapped(bh)). It was h