Re: [ext3][kernels = 2.6.20.7 at least] KDE going comatose when FS is under heavy write load (massive starvation)

2007-05-03 Thread Andrew Morton
On Thu, 03 May 2007 21:38:10 +0400 Alex Tomas [EMAIL PROTECTED] wrote: Andrew Morton wrote: We can make great improvements here, and I've (twice) previously decribed how: hoist the entire ordered-mode data handling out of ext3, and out of the buffer_head layer and move it up into the VFS

Re: [PATCH 1/5] fallocate() implementation in i86, x86_64 and powerpc

2007-05-03 Thread Andrew Morton
On Thu, 26 Apr 2007 23:33:32 +0530 Amit K. Arora [EMAIL PROTECTED] wrote: This patch implements the fallocate() system call and adds support for i386, x86_64 and powerpc. ... +asmlinkage long sys_fallocate(int fd, int mode, loff_t offset, loff_t len) Please add a comment over this

Re: [PATCH 3/5] ext4: Extent overlap bugfix

2007-05-03 Thread Andrew Morton
On Thu, 26 Apr 2007 23:41:01 +0530 Amit K. Arora [EMAIL PROTECTED] wrote: +unsigned int ext4_ext_check_overlap(struct inode *inode, + struct ext4_extent *newext, + struct ext4_ext_path *path) +{ + unsigned long b1,

Re: [PATCH 5/5] ext4: write support for preallocated blocks/extents

2007-05-03 Thread Andrew Morton
On Thu, 26 Apr 2007 23:46:23 +0530 Amit K. Arora [EMAIL PROTECTED] wrote: This patch adds write support for preallocated (using fallocate system call) blocks/extents. The preallocated extents in ext4 are marked uninitialized, hence they need special handling especially while writing to them.

Re: [PATCH 1/5] fallocate() implementation in i86, x86_64 and powerpc

2007-05-03 Thread Andrew Morton
On Thu, 3 May 2007 21:29:55 -0700 Andrew Morton [EMAIL PROTECTED] wrote: + ret = -EFBIG; + if (offset + len inode-i_sb-s_maxbytes) + goto out_fput; This code does handle offset+len going negative, but only by accident, I suspect. But it doesn't handle offset+len wrapping

Re: [ext3][kernels = 2.6.20.7 at least] KDE going comatose when FS is under heavy write load (massive starvation)

2007-04-27 Thread Andrew Morton
On Fri, 27 Apr 2007 09:59:27 +0200 Mike Galbraith [EMAIL PROTECTED] wrote: Greetings, As subject states, my GUI is going away for extended periods of time when my very full and likely highly fragmented (how to find out) filesystem is under heavy write load. While write is under way, if

Re: [ext3][kernels = 2.6.20.7 at least] KDE going comatose when FS is under heavy write load (massive starvation)

2007-04-27 Thread Andrew Morton
On Fri, 27 Apr 2007 13:31:30 -0600 Andreas Dilger [EMAIL PROTECTED] wrote: On Apr 27, 2007 08:30 -0700, Linus Torvalds wrote: On a good filesystem, when you do fsync() on a file, nothing at all happens to any other files. On ext3, it seems to sync the global journal, which means that

Re: [PATCH] Copy i_flags to ext3 inode flags on write (version 2)

2007-04-20 Thread Andrew Morton
On Tue, 17 Apr 2007 12:38:55 +0200 Jan Kara [EMAIL PROTECTED] wrote: attached is a second version of a patch that stores inode flags such as S_IMMUTABLE, S_APPEND, etc. from i_flags to EXT3_I(inode)-i_flags when inode is written to disk. The same thing is done on GETFLAGS ioctl. Quota

Re: [PATCH] Check for error returned by kthread_create on creating journal thread

2007-04-20 Thread Andrew Morton
On Mon, 16 Apr 2007 11:41:14 +0400 Pavel Emelianov [EMAIL PROTECTED] wrote: If the thread failed to create the subsequent wait_event will hang forever. This is likely to happen if kernel hits max_threads limit. Will be critical for virtualization systems that limit the number of tasks

Re: Performance degradation with FFSB between 2.6.20 and 2.6.21-rc7

2007-04-18 Thread Andrew Morton
On Wed, 18 Apr 2007 15:54:00 +0200 Valerie Clement [EMAIL PROTECTED] wrote: Running benchmark tests (FFSB) on an ext4 filesystem, I noticed a performance degradation (about 15-20 percent) in sequential write tests between 2.6.19-rc6 and 2.6.21-rc4 kernels. I ran the same tests on ext3

Re: [PATCH] ext[34] EA block reference count racing fix

2007-03-22 Thread Andrew Morton
On Wed, 21 Feb 2007 15:54:10 -0800 Mingming Cao [EMAIL PROTECTED] wrote: There are race issues around ext[34] xattr block release code. ext[34]_xattr_release_block() checks the reference count of xattr block (h_refcount) and frees that xattr block if it is the last one reference it. Unlike

Fw: EXT3-fs warning (device sdd2): dx_probe: Unrecognised inode hash code 232

2007-03-09 Thread Andrew Morton
Begin forwarded message: Date: Thu, 8 Mar 2007 18:35:54 +0100 From: Jan De Luyck [EMAIL PROTECTED] To: linux-kernel@vger.kernel.org Subject: EXT3-fs warning (device sdd2): dx_probe: Unrecognised inode hash code 232 Hello, Running 2.6.19.1 on AMD64. While copying some files on an ext3

Re: [RFC] Heads up on sys_fallocate()

2007-03-01 Thread Andrew Morton
On Fri, 2 Mar 2007 00:04:45 +0530 Amit K. Arora [EMAIL PROTECTED] wrote: This is to give a heads up on few patches that we will be soon coming up with. These patches implement a new system call sys_fallocate() and a new inode operation fallocate, for persistent preallocation. The new system

Re: [RFC] Heads up on sys_fallocate()

2007-03-01 Thread Andrew Morton
On Thu, 01 Mar 2007 22:44:16 + Dave Kleikamp [EMAIL PROTECTED] wrote: On Thu, 2007-03-01 at 14:25 -0800, Andrew Morton wrote: On Fri, 2 Mar 2007 00:04:45 +0530 Amit K. Arora [EMAIL PROTECTED] wrote: +asmlinkage long sys_fallocate(int fd, loff_t offset, loff_t len) +{ + struct

Re: [RFC] Heads up on sys_fallocate()

2007-03-01 Thread Andrew Morton
On Thu, 01 Mar 2007 22:03:55 -0800 Badari Pulavarty [EMAIL PROTECTED] wrote: Just curious .. What does posix_fallocate() return ? bookmark this: http://www.opengroup.org/onlinepubs/009695399/nfindex.html Upon successful completion, posix_fallocate() shall return zero; otherwise, an

Re: [Resubmit][Patch 0/2] Persistent preallocation in ext4

2007-02-25 Thread Andrew Morton
On Wed, 17 Jan 2007 15:16:58 +0530 Amit K. Arora [EMAIL PROTECTED] wrote: (1) The final interface is yet to be decided. We have the option of chosing from one of these: a modifying posix_fallocate() in glibc b using fcntl c using ftruncate, or d using the ioctl

Re: loopback mount EXT3 oops

2007-02-18 Thread Andrew Morton
On Mon, 19 Feb 2007 10:52:42 +1100 Rusty Russell [EMAIL PROTECTED] wrote: Hi all, This happened on 2.6.20-rc6-mm3, so I upgraded to 2.6.20-git14, and same thing happened. Doing a forced fsck on the (corrupted by double-mounting I think) filesystem fixed it, but I took a copy before

Re: booked-page-flag.patch

2007-02-16 Thread Andrew Morton
On Fri, 16 Feb 2007 10:56:55 +0300 Alex Tomas [EMAIL PROTECTED] wrote: Andrew Morton (AM) writes: AM Well, one could just assume that the page has no disk mapping and go and AM make the space reservation. Things will work out OK when we come to do AM writepage(). AM Or one could do

Re: data=journal busted

2007-02-16 Thread Andrew Morton
On Fri, 16 Feb 2007 14:50:22 -0800 Randy Dunlap [EMAIL PROTECTED] wrote: On Thu, 15 Feb 2007 20:44:45 -0800 Andrew Morton wrote: I have a report from a google person who just did some basic power-it-off-during-a-write testing on 2.6.20's ext3. ordered-data is OK, but data=journal

Re: data=journal busted

2007-02-16 Thread Andrew Morton
On Fri, 16 Feb 2007 16:31:09 -0700 Andreas Dilger [EMAIL PROTECTED] wrote: I suspect we should resurrect and formalise my old make-the-disk-stop-accepting-writes-when-a-timer-goes-off thing. It was very useful for stress-testing recovery. We have a patch that we use for Lustre testing

i_version_2_ext4_specific_code

2007-02-15 Thread Andrew Morton
This: ftp://ftp.kernel.org/pub/linux/kernel/people/tytso/ext4-patches/2.6.20-ext4-1/broken-out/i_version_2_ext4_specific_code has 100% broken whitespace: it uses spaces where there should be hard tabs. Please let's not merge anything which does that. - To unsubscribe from this list: send the

booked-page-flag.patch

2007-02-15 Thread Andrew Morton
Sorry, we're seriously, seriously, seriously short on flags in the page struct and this patch is going to need one heck of a good case for it to be acceptable. Even then, we should put a lot of effort into finding some way of avoiding adding that page flag. One option might be to add a new

i_version_3_ext4_user_interface.patch

2007-02-15 Thread Andrew Morton
ia64 allmodconfig gives: fs/stat.c: In function `cp_new_stat': fs/stat.c:234: error: structure has no member named `st_i_version' I'll drop the ext4 tree. - To unsubscribe from this list: send the line unsubscribe linux-ext4 in the body of a message to [EMAIL PROTECTED] More majordomo info at

Re: booked-page-flag.patch

2007-02-15 Thread Andrew Morton
On Thu, 15 Feb 2007 20:30:43 +0300 Alex Tomas [EMAIL PROTECTED] wrote: Eric Sandeen (ES) writes: ES Andrew Morton wrote: Sorry, we're seriously, seriously, seriously short on flags in the page struct and this patch is going to need one heck of a good case for it to be acceptable

Re: booked-page-flag.patch

2007-02-15 Thread Andrew Morton
On Fri, 16 Feb 2007 00:07:55 +0300 Alex Tomas [EMAIL PROTECTED] wrote: Andrew Morton (AM) writes: AM If the page doesn't have buffer-heads, set PG_private and clear page-private AM If the page does have buffer_heads, use BH_Delay. I did exactly this way in the first version

data=journal busted

2007-02-15 Thread Andrew Morton
I have a report from a google person who just did some basic power-it-off-during-a-write testing on 2.6.20's ext3. ordered-data is OK, but data=journal came back with crap in the file data. Is anyone doing any formal recovery stress-testing? I suspect we should resurrect and formalise my old

Re: booked-page-flag.patch

2007-02-15 Thread Andrew Morton
On Fri, 16 Feb 2007 10:30:39 +0300 Alex Tomas [EMAIL PROTECTED] wrote: Andrew Morton (AM) writes: - get_block(with BH_Delay) can be used to signal filesystem that no actual allocation is required. so, aware filesystem can just reserve space. then - writepages() should walk through

Re: [RFC][PATCH 2/3] Move the file data to the new blocks

2007-02-08 Thread Andrew Morton
On Thu, 8 Feb 2007 10:29:45 +0100 Jan Kara [EMAIL PROTECTED] wrote: On Wed 07-02-07 12:56:59, Andrew Morton wrote: On Wed, 7 Feb 2007 13:46:57 -0700 Andreas Dilger [EMAIL PROTECTED] wrote: On Feb 06, 2007 17:35 -0800, Andrew Morton wrote: On Mon, 5 Feb 2007 14:12:04 +0100 Jan

Re: [RFC][PATCH 2/3] Move the file data to the new blocks

2007-02-08 Thread Andrew Morton
On Thu, 8 Feb 2007 11:21:02 +0100 Jan Kara [EMAIL PROTECTED] wrote: On Thu 08-02-07 01:45:29, Andrew Morton wrote: snip I though Andreas meant any write changes - i.e. you check that noone has open file descriptor for writing and block any new open for writing. That can be done

Re: [RFC][PATCH 2/3] Move the file data to the new blocks

2007-02-07 Thread Andrew Morton
On Wed, 7 Feb 2007 13:46:57 -0700 Andreas Dilger [EMAIL PROTECTED] wrote: On Feb 06, 2007 17:35 -0800, Andrew Morton wrote: On Mon, 5 Feb 2007 14:12:04 +0100 Jan Kara [EMAIL PROTECTED] wrote: Move the blocks on the temporary inode to the original inode by a page. 1. Read

Re: [RFC][PATCH 2/3] Move the file data to the new blocks

2007-02-06 Thread Andrew Morton
On Tue, 16 Jan 2007 21:05:20 +0900 [EMAIL PROTECTED] wrote: Move the blocks on the temporary inode to the original inode by a page. 1. Read the file data from the old blocks to the page 2. Move the block on the temporary inode to the original inode 3. Write the file data on the page into the

Re: [RFC][PATCH 2/3] Move the file data to the new blocks

2007-02-06 Thread Andrew Morton
On Mon, 5 Feb 2007 14:12:04 +0100 Jan Kara [EMAIL PROTECTED] wrote: Move the blocks on the temporary inode to the original inode by a page. 1. Read the file data from the old blocks to the page 2. Move the block on the temporary inode to the original inode 3. Write the file data on the

Re: [PATCH 0/1][RFC] mm: prepare_write positive return value

2007-02-06 Thread Andrew Morton
On Tue, 06 Feb 2007 11:33:46 +0300 Dmitriy Monakhov [EMAIL PROTECTED] wrote: Almost all read/write operation handles data with chunks(segments or pages) and result has integral behaviour for folowing scenario: for_each_chunk() { res = op(); if(IS_ERROR(res)) return

Fw: [BUG -mm] ext3_orphan_add() accessing corrupted list on a corrupted ext3fs

2007-02-01 Thread Andrew Morton
Begin forwarded message: Date: Thu, 1 Feb 2007 16:44:39 +0800 From: Fengguang Wu [EMAIL PROTECTED] To: LKML linux-kernel@vger.kernel.org Subject: [BUG -mm] ext3_orphan_add() accessing corrupted list on a corrupted ext3fs I accidentally ran two qemu instances on the same ext3 fs, after that

Re: How git affects kernel.org performance

2007-01-07 Thread Andrew Morton
On Sun, 7 Jan 2007 09:55:26 +0100 Willy Tarreau [EMAIL PROTECTED] wrote: On Sat, Jan 06, 2007 at 09:39:42PM -0800, Linus Torvalds wrote: On Sat, 6 Jan 2007, H. Peter Anvin wrote: During extremely high load, it appears that what slows kernel.org down more than anything else

Re: Ok, explained.. (was Re: [PATCH] mm: fix page_mkclean_one)

2006-12-29 Thread Andrew Morton
On Fri, 29 Dec 2006 18:32:07 -0500 Theodore Tso [EMAIL PROTECTED] wrote: On Fri, Dec 29, 2006 at 02:42:51PM -0800, Linus Torvalds wrote: I think ext3 is terminally crap by now. It still uses buffer heads in places where it really really shouldn't, and as a result, things like directory

Re: [RFC] ext4-block-reservation.patch

2006-12-23 Thread Andrew Morton
On Fri, 22 Dec 2006 23:25:16 +0300 Alex Tomas [EMAIL PROTECTED] wrote: Once this code is settled in we should consider removal of the existing reservations code from ext4. + +struct ext4_reservation_slot { + __u64 rs_reserved; + spinlock_t rs_lock; +}

Re: [RFC] [PATCH] Fix kmalloc flags used in ext3 with an active journal handle

2006-12-19 Thread Andrew Morton
On Tue, 19 Dec 2006 17:58:12 -0800 Suzuki [EMAIL PROTECTED] wrote: * Fix the kmalloc flags used from within ext3, when we have an active journal handle If we do a kmalloc with GFP_KERNEL on system running low on memory, with an active journal handle, we might end up in cleaning up

Re: Boot failure with ext2 and initrds

2006-11-28 Thread Andrew Morton
On Tue, 28 Nov 2006 13:04:53 -0800 Mingming Cao [EMAIL PROTECTED] wrote: Thanks, I have acked most of them, and will port them to ext3/4 soon. You've acked #2 and #3. #4, #5 and #6 remain un-commented-upon and #1 is unclear? - To unsubscribe from this list: send the line unsubscribe linux-ext4

Re: Boot failure with ext2 and initrds

2006-11-16 Thread Andrew Morton
On Thu, 16 Nov 2006 00:49:20 -0800 Mingming Cao [EMAIL PROTECTED] wrote: On Wed, 2006-11-15 at 23:22 -0800, Andrew Morton wrote: On Wed, 15 Nov 2006 22:55:43 -0800 Mingming Cao [EMAIL PROTECTED] wrote: Hmm, maxblocks, in bitmap_search_next_usable_block(), is the end block number

Re: Boot failure with ext2 and initrds

2006-11-16 Thread Andrew Morton
On Thu, 16 Nov 2006 12:15:16 -0800 Mingming Cao [EMAIL PROTECTED] wrote: On Thu, 2006-11-16 at 01:13 -0800, Andrew Morton wrote: On Thu, 16 Nov 2006 00:49:20 -0800 Mingming Cao [EMAIL PROTECTED] wrote: On Wed, 2006-11-15 at 23:22 -0800, Andrew Morton wrote: On Wed, 15 Nov 2006 22

Re: pagefault in generic_file_buffered_write() causing deadlock

2006-11-15 Thread Andrew Morton
On Wed, 15 Nov 2006 07:57:45 -0800 Badari Pulavarty [EMAIL PROTECTED] wrote: We are looking at a customer situation (on 2.6.16-based distro) - where system becomes almost useless while running some java stress tests. Root cause seems to be taking a pagefault in generic_file_buffered_write

Fw: Errors reported by Coverity in ext3.

2006-11-09 Thread Andrew Morton
Begin forwarded message: Date: Thu, 1 Dec 2005 08:54:18 -0800 From: Jayachandran C. [EMAIL PROTECTED] To: [EMAIL PROTECTED] Cc: [EMAIL PROTECTED] Subject: Errors reported by Coverity in ext3. [Re-sending to the ext3 list, with minor edits] I'm in the process of fixing errors generated by the

Fw: Re: ICP, 3ware, Areca?

2006-11-07 Thread Andrew Morton
Why is ext3 slow?? Begin forwarded message: Date: Tue, 7 Nov 2006 09:47:17 -0500 From: Bill Rugolsky Jr. [EMAIL PROTECTED] To: Arne Schmitz [EMAIL PROTECTED] Cc: [EMAIL PROTECTED] Subject: Re: ICP, 3ware, Areca? On Tue, Nov 07, 2006 at 03:25:04PM +0100, Arne Schmitz wrote: Has anyone

Re: 2.6.19-rc1-mm1 (ext4 problem ?)

2006-10-11 Thread Andrew Morton
On Wed, 11 Oct 2006 08:02:14 -0700 Badari Pulavarty [EMAIL PROTECTED] wrote: On Tue, 2006-10-10 at 21:01 -0700, Andrew Morton wrote: Andrew Morton wrote: ftp://ftp.kernel.org/pub/linux/kernel/people/akpm/patches/2.6/2.6.19-rc1/2.6.19-rc1-mm1/ - Added the ext4 filesystem

Re: Updated ext4/jbd2 patches based on 2.6.19-rc1

2006-10-10 Thread Andrew Morton
On Tue, 10 Oct 2006 13:24:02 +0530 Suparna Bhattacharya [EMAIL PROTECTED] wrote: On Mon, Oct 09, 2006 at 11:29:27PM -0700, Andrew Morton wrote: On Thu, 5 Oct 2006 17:39:33 -0700 Andrew Morton [EMAIL PROTECTED] wrote: Could we please have a few nice words about ext4 for the record

Re: [PATCH] Get rid of extents mount option - try 2

2006-10-10 Thread Andrew Morton
On Tue, 10 Oct 2006 17:07:18 -0400 Theodore Tso [EMAIL PROTECTED] wrote: On Tue, Oct 10, 2006 at 01:48:18PM -0500, Dave Kleikamp wrote: On Sat, 2006-10-07 at 13:20 -0400, Theodore Tso wrote: On Sat, Oct 07, 2006 at 10:53:47AM -0500, Dave Kleikamp wrote: I noticed we are missing

Re: Updated ext4/jbd2 patches based on 2.6.19-rc1

2006-10-06 Thread Andrew Morton
On Thu, 5 Oct 2006 23:53:05 -0600 Andreas Dilger [EMAIL PROTECTED] wrote: On Oct 05, 2006 21:54 -0700, Randy Dunlap wrote: On Thu, 5 Oct 2006 20:55:26 -0700 Andrew Morton wrote: If you then mount this filesystem with `-t ext4dev -o extents', it becomes incompatible with the ext3 driver

Re: Updated ext4/jbd2 patches based on 2.6.19-rc1

2006-10-06 Thread Andrew Morton
On Thu, 5 Oct 2006 23:58:29 -0600 Andreas Dilger [EMAIL PROTECTED] wrote: but the patches have not been changed for ext4 (which should really default to using extents on a filesystem with the INCOMPAT_EXTENT feature set unless told otherwise). That is a necessity for filesystems larger than

Re: [patch 003/152] jbd: fix commit of ordered data buffers

2006-09-29 Thread Andrew Morton
On Fri, 29 Sep 2006 21:54:30 +0200 Andi Kleen [EMAIL PROTECTED] wrote: On Friday 29 September 2006 21:18, Ingo Molnar wrote: * Andrew Morton [EMAIL PROTECTED] wrote: gad, there have been so many all-CPU-backtrace patches over the years. optimistically cc's Ingo Ingo, do

Re: [PATCH] ext3_getblk should handle HOLE correctly

2006-09-07 Thread Andrew Morton
On Wed, 06 Sep 2006 10:39:06 -0700 Badari Pulavarty [EMAIL PROTECTED] wrote: Hi Andrew, Its been reported that ext3_getblk() is not doing the right thing and triggering following WARN(): BUG: warning at fs/ext3/inode.c:1016/ext3_getblk() c01c5140 ext3_getblk+0x98/0x2a6 c03b2806

Re: [RFC][PATCH] set_page_buffer_dirty should skip unmapped buffers

2006-09-06 Thread Andrew Morton
On Wed, 06 Sep 2006 20:04:27 -0700 Badari Pulavarty [EMAIL PROTECTED] wrote: I've been unable to reproduce this crash, btw. Is there some magic incantation apat from running `fsx-linux'? All I do is on a single 1k filesystem, run 4 copies of fsx (on 4 different files, ofcourse). I

<    1   2