[Take 2]e2fsprogs: Undo I/O manager

2007-07-19 Thread Aneesh Kumar K.V
This patch fixes some bugs found during testing of the large inode migration patches. -aneesh - To unsubscribe from this list: send the line unsubscribe linux-ext4 in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html

[PATCH 2/2] e2fsprogs: Add undoe2fs

2007-07-19 Thread Aneesh Kumar K.V
From: Aneesh Kumar K.V [EMAIL PROTECTED] undoe2fs can be used to replay the transaction saved in the transaction file using undo I/O Manager Signed-off-by: Aneesh Kumar K.V [EMAIL PROTECTED] --- misc/Makefile.in | 10 +- misc/undoe2fs.c | 77

[PATCH] Update series file

2007-07-16 Thread Aneesh Kumar K.V
I think the series file got updated wrongly -aneesh diff --git a/series b/series index 183d72e..bf34353 100644 --- a/series +++ b/series @@ -2,14 +2,10 @@ # fallocate() syscall patches and ext4 fallocate() implementation # Missing manpages -ext4-fallocate-1-syscall_i386_amd64_ppc

e2fsprogs: Undo I/O manager

2007-07-11 Thread Aneesh Kumar K.V
Hi Ted, Following patch implement the Undo I/O manager and undoe2fs. The patches are on top of latest git(23edf9b4674ced1cdf8625bd609d95dbd62923b3) -aneesh - To unsubscribe from this list: send the line unsubscribe linux-ext4 in the body of a message to [EMAIL PROTECTED] More majordomo

[PATCH 2/2] e2fsprogs: Add undoe2fs

2007-07-11 Thread Aneesh Kumar K.V
From: Aneesh Kumar K.V [EMAIL PROTECTED] undoe2fs can be used to replay the transaction saved in the transaction file using undo I/O Manager Signed-off-by: Aneesh Kumar K.V [EMAIL PROTECTED] --- misc/Makefile.in | 10 -- misc/undoe2fs.c | 48

Re: Ext3 onlie resize failure due to small journal size

2007-07-11 Thread Aneesh Kumar K.V
Andreas Dilger wrote: On Jul 11, 2007 19:30 +0530, Suzuki wrote: Trying to resize a mounted ext3 filesystem fails due to small journal size. Background : The filesystem was created with default values, except blocksize = 4K on a LV partition. Later we tried extended the partition to +16M

Re: simple block bitmap sanity checking

2007-07-09 Thread Aneesh Kumar K.V
Andreas Dilger wrote: During a discussion at OLS, I came up with a very simple way of validating the ext2/3/4 block bitmaps at read time. Until such a time when we have checksums for the bitmaps we can have a simple but quite robust mechanism that is useful for ext2/3/4. When a new block

[PATCH] ext2/ext3/ext4: Add block bitmap validation

2007-07-09 Thread Aneesh Kumar K.V
When a new block bitmap is read from disk in read_block_bitmap() there are a few bits that should ALWAYS be set. In particular, the blocks given by ext4_blk_bitmap, ext4_inode_bitmap and ext4_inode_table. Validate the block bitmap against these blocks. Signed-off-by: Aneesh Kumar K.V [EMAIL

[PATCH] ext2/ext3/ext4: Add block bitmap validation

2007-07-09 Thread Aneesh Kumar K.V
When a new block bitmap is read from disk in read_block_bitmap() there are a few bits that should ALWAYS be set. In particular, the blocks given by ext4_blk_bitmap, ext4_inode_bitmap and ext4_inode_table. Validate the block bitmap against these blocks. Signed-off-by: Aneesh Kumar K.V [EMAIL

[PATCH]mballoc rebased on top of ext4-patch-queue.

2007-07-05 Thread Aneesh Kumar K.V
The patch set is forward port of the changes found at ftp://ftp.clusterfs.com/pub/people/alex/2.6.19-rc6/ on top of 2.6.22-rc6 (ext4-patch-queue) Only visible change i made is to enabled MBALLOC option default so that we get wider testing. Test booted and did minimal testing on ext4 files

[PATCH 2/4] Add support for locality group.

2007-07-05 Thread Aneesh Kumar K.V
From: Alex Tomas [EMAIL PROTECTED] Signed-off-by: Aneesh Kumar K.V [EMAIL PROTECTED] --- fs/ext4/Makefile |2 +- fs/ext4/lg.c | 576 fs/ext4/super.c|5 + fs/fs-writeback.c |8 +- include/linux

Re: [EXT4 set 3][PATCH 1/1] ext4 nanosecond timestamp

2007-07-04 Thread Aneesh Kumar K.V
Aneesh Kumar K.V wrote: Mingming Cao wrote: On Tue, 2007-07-03 at 15:58 +0530, Kalpak Shah wrote: On Sun, 2007-07-01 at 03:36 -0400, Mingming Cao wrote: + +#define EXT4_INODE_GET_XTIME(xtime, inode, raw_inode) \ +do

Re: [EXT4 set 4][PATCH 4/5] i_version:ext4 inode version update

2007-07-03 Thread Aneesh Kumar K.V
Mingming Cao wrote: Index: linux-2.6.22-rc4/fs/ext4/super.c === --- linux-2.6.22-rc4.orig/fs/ext4/super.c 2007-06-13 17:19:11.0 -0700 +++ linux-2.6.22-rc4/fs/ext4/super.c2007-06-13 17:24:45.0 -0700 @@

finding the author of the patches in ext4-patch-queue

2007-07-03 Thread Aneesh Kumar K.V
off extents. Signed-off-by: Mingming Cao [EMAIL PROTECTED] Without the change: I get below commit 4a4f228f99e263767fe5b395cdb843a5c5d083fe Author: Aneesh Kumar K.V [EMAIL PROTECTED] Date: Wed Jul 4 10:05:19 2007 +0530 Turn on extents feature by default in ext4 filesystem. User could

Re: [EXT4 set 4][PATCH 4/5] i_version:ext4 inode version update

2007-07-03 Thread Aneesh Kumar K.V
Aneesh Kumar K.V wrote: If we bump i_version in ext4_mark_iloc_dity then we should be removing the i_version update at other places. A simple grep of ext4 dir shows i_version being updated followed by ext4_mark_inode_dirty. How about the below patch. I also removed the i_version = 1

Re: [EXT4 set 4][PATCH 4/5] i_version:ext4 inode version update

2007-07-03 Thread Aneesh Kumar K.V
Aneesh Kumar K.V wrote: If we bump i_version in ext4_mark_iloc_dity then we should be removing the i_version update at other places. A simple grep of ext4 dir shows i_version being updated followed by ext4_mark_inode_dirty. How about the below patch. I also removed the i_version = 1

[PATCH 2/2] Add EXT4_IOC_MIGRATE ioctl

2007-06-28 Thread Aneesh Kumar K.V
From: Aneesh Kumar K.V [EMAIL PROTECTED] The below patch add ioctl for migrating ext3 indirect block mapped inode to ext4 extent mapped inode. Signed-off-by: Aneesh Kumar K.V [EMAIL PROTECTED] --- fs/ext4/Makefile|2 +- fs/ext4/ioctl.c |3 + fs/ext4/migrate.c

Re: [RFC][PATCH 1/11][take 2] add new mkfs option to create ext4 filesystems

2007-06-25 Thread Aneesh Kumar K.V
Valerie Clement wrote: This patch adds a new option '-D' to mkfs to allow creating ext4 filesystem. lib/ext2fs/ext2_fs.h|7 +++ lib/ext2fs/initialize.c |1 + misc/mke2fs.c | 18 -- 3 files changed, 24 insertions(+), 2 deletions(-)

[PATCH] e2fsprogs: Add undo I/O manager [ Was Re: E2fsprogs 1.40 release imminent! ]

2007-06-25 Thread Aneesh Kumar K.V
, superblock, block_size, undo_io_manager, current_fs); The patch is on top of e2fsprogs-upstream mercurial repo Signed-off-by: Aneesh Kumar K.V [EMAIL PROTECTED] diff -r fe55db3e508c lib/ext2fs/Makefile.in --- a/lib/ext2fs/Makefile.inSun Jun 24 17:32:47 2007

ext4-block-reservation.patch

2007-06-19 Thread Aneesh Kumar K.V
Hi, In block reservation code while rebalancing the free blocks why are we not looking at the reservation slots that have no free blocks left. Rebalancing the free blocks equally across all the reservation slots will make sure we have less chances of failure later when we try to reserve

Re: delayed allocatiou result in Oops

2007-06-19 Thread Aneesh Kumar K.V
Mingming Cao wrote: O BTW, can you point me your latest and greatest mballoc patch? I am trying to forward port and merge that patch to ext4 patch queue I am looking at the one found at. ftp://ftp.clusterfs.com/pub/people/alex/2.6.19-rc6 -aneesh - To unsubscribe from this list:

Re: ext4-block-reservation.patch

2007-06-19 Thread Aneesh Kumar K.V
Eric Sandeen wrote: Aneesh Kumar K.V wrote: Hi, In block reservation code while rebalancing the free blocks why are we not looking at the reservation slots that have no free blocks left. Rebalancing the free blocks equally across all the reservation slots will make sure we have less

Re: ext4-block-reservation.patch

2007-06-19 Thread Aneesh Kumar K.V
Aneesh Kumar K.V wrote: Eric Sandeen wrote: Aneesh Kumar K.V wrote: Hi, In block reservation code while rebalancing the free blocks why are we not looking at the reservation slots that have no free blocks left. Rebalancing the free blocks equally across all the reservation slots

Add EXT4_IOC_MIGRATE ioctl

2007-06-12 Thread Aneesh Kumar K.V
Corporation, 2007 + * Author Aneesh Kumar K.V [EMAIL PROTECTED] + * + * This program is free software; you can redistribute it and/or modify it + * under the terms of version 2.1 of the GNU Lesser General Public License + * as published by the Free Software Foundation. + * + * This program

Re: Add EXT4_IOC_MIGRATE ioctl

2007-06-12 Thread Aneesh Kumar K.V
Andreas Dilger wrote: On Jun 12, 2007 12:17 +0530, Aneesh Kumar K.V wrote: The below patch add ioctl for migrating ext3 indirect block mapped inode to ext4 extent mapped inode. How does this relate to the migrate ioctl used by Takashi in the current ext4 defragmenter patch series? You

[PATCH 1/1] e2fsprogs: Add undo I/O manager.

2007-06-08 Thread Aneesh Kumar K.V
, flags, superblock, block_size, undo_io_manager, current_fs); The patch is on top of e2fsprogs-upstream mercurial repo Signed-off-by: Aneesh Kumar K.V [EMAIL PROTECTED] diff -r 11b6e3e021f0 lib/ext2fs/Makefile.in --- a/lib/ext2fs/Makefile.inThu May 31 12:39

Re: [RFC PATCH 1/1] e2fsprogs: Add undo I/O manager.

2007-06-07 Thread Aneesh Kumar K.V
Theodore Tso wrote: On Wed, Jun 06, 2007 at 03:32:27PM +0530, Aneesh Kumar K.V wrote: If we allow to change the block size in between that would mean the records that we store in the tdb database will be of variable size ( different block sizes). That would also add all the code/complexity

Re: [RFC PATCH 1/1] e2fsprogs: Add undo I/O manager.

2007-06-06 Thread Aneesh Kumar K.V
Theodore Tso wrote: On Tue, May 22, 2007 at 03:47:33PM +0530, Aneesh Kumar K.V wrote: This I/O manager saves the contents of the location being overwritten to a tdb database. This helps in undoing the changes done to the file system. + /* loop through the existing entries and find

Online defragmentation

2007-05-30 Thread Aneesh Kumar K.V
Hi Takashi, I was looking at online defrag code and found that the tmp_inode is created with tmp_inode-i_nlink equal to zero. Now i am not sure whether i understand the code correctly, but AFAIU we allocate contiguous block using this tmp_inode. That means tmp_inode have extent details

Re: [PATCH] update ext4-nanosecond-patch comments

2007-05-29 Thread Aneesh Kumar K.V
Kalpak Shah wrote: On Tue, 2007-05-29 at 11:18 +0530, Aneesh Kumar K.V wrote: Also can we have a description of why s_{min, want}_extra_isize fields are added in the commit message ? The i_extra_isize for each inode should ideally be s_want_extra_isize after inode expansion. If expansion

Re: [PATCH] update ext4-nanosecond-patch comments

2007-05-29 Thread Aneesh Kumar K.V
Andreas Dilger wrote: On May 29, 2007 13:48 +0530, Aneesh Kumar K.V wrote: When the nanosecond timestamp extension was first proposed, the requirement from Ted and Stephen were that s_min_extra_isize was a requirement. Otherwise it would be possible to have a filesystem where

[PATCH] update ext4-nanosecond-patch comments

2007-05-28 Thread Aneesh Kumar K.V
Also can we have a description of why s_{min, want}_extra_isize fields are added in the commit message ? diff --git a/ext4-nanosecond-patch b/ext4-nanosecond-patch index ceaf339..02d00b7 100644 --- a/ext4-nanosecond-patch +++ b/ext4-nanosecond-patch @@ -1,8 +1,8 @@ This patch is a spinoff of

Re: which tree should I generate the ext4 patch ?

2007-05-24 Thread Aneesh Kumar K.V
coly wrote: Theodore, I can see all the files, but how can I download the files by cvs ? I tried pserver, but it seems does not work .. could you give me some hints ? hg clone http://thunk.org/hg/e2fsprogs/ hg come in mercurial package. -aneesh - To unsubscribe from this list: send

Re: [PATCH 1/2] Add stack I/O manager.

2007-05-21 Thread Aneesh Kumar K.V
Theodore Tso wrote: On Wed, May 09, 2007 at 01:42:17PM +0530, Aneesh Kumar K.V wrote: From: Aneesh Kumar K.V [EMAIL PROTECTED] This I/O manager helps in stacking different I/O managers. For example one can stack the undo I/O manager on top of Unix I/O manager to achieve the undo

Re: Online defragmentation and ext4migrate

2007-05-21 Thread Aneesh Kumar K.V
Takashi Sato wrote: Hi Aneesh san, In my opinion, to keep the ioctl simple and small is very important for ease of maintenance. So I would rather not support indirect block files in the ioctl. Instead, I can add the call of the migration ioctl to my defrag tool in order to defragment

Re: Ext4 Patch Queue using stgit.

2007-05-18 Thread Aneesh Kumar K.V
Dave Kleikamp wrote: On Fri, 2007-05-18 at 18:12 +0530, Aneesh Kumar K.V wrote: Hi All, I was looking at ext4 patch queue and was wondering why we are putting .patch under git. If we are looking for a quilt like functionality, one can achieve the same using stgit. I was using stgit

Re: Ext4 Patch Queue using stgit.

2007-05-18 Thread Aneesh Kumar K.V
Theodore Tso wrote: On Fri, May 18, 2007 at 06:12:23PM +0530, Aneesh Kumar K.V wrote: Hi All, I was looking at ext4 patch queue and was wondering why we are putting .patch under git. If we are looking for a quilt like functionality, one can achieve the same using stgit. I was using stgit

e2fsprogs: Undo I/O manager

2007-05-09 Thread Aneesh Kumar K.V
This is a very early prototype of what i working on. I have done only minimal testing of this. To use one need to use the below steps. io_manager io_mng = stack_io_manager_init(); stack_push_io_manager(io_mng, unix_io_manager); stack_push_io_manager(io_mng, undo_io_manager);

[PATCH 1/2] Add stack I/O manager.

2007-05-09 Thread Aneesh Kumar K.V
From: Aneesh Kumar K.V [EMAIL PROTECTED] This I/O manager helps in stacking different I/O managers. For example one can stack the undo I/O manager on top of Unix I/O manager to achieve the undo functionality. Signed-off-by: Aneesh Kumar K.V [EMAIL PROTECTED] --- lib/ext2fs/Makefile.in | 10

[PATCH 2/2] Add undo I/O manager.

2007-05-09 Thread Aneesh Kumar K.V
From: Aneesh Kumar K.V [EMAIL PROTECTED] This I/O manager saves the contents of the location being overwritten to a tdb database. This helps in undoing the changes done to the file system. This can be stacked over unix I/O manager to get the undo functionality. Signed-off-by: Aneesh Kumar K.V

[PATCH 1/2] Add stack I/O manager.

2007-05-09 Thread Aneesh Kumar K.V
This I/O manager helps in stacking different I/O managers. For example one can stack the undo I/O manager on top of Unix I/O manager to achieve the undo functionality. Signed-off-by: Aneesh Kumar K.V [EMAIL PROTECTED] --- lib/ext2fs/Makefile.in | 10 +- lib/ext2fs/ext2_io.h |4 + lib

Re: [RFC][take 4] e2fsprogs: Add ext4migrate

2007-05-07 Thread Aneesh Kumar K.V
Hi, Theodore Tso wrote: On Mon, May 07, 2007 at 08:56:11AM +0530, Aneesh Kumar K.V wrote: Andreas Dilger wrote: If this code could also (or optionally just) increase the size of inodes it would be very useful. AFAIK right now it will only change the inodes from block-mapped to extent-mapped

Re: [RFC][take 4] e2fsprogs: Add ext4migrate

2007-05-07 Thread Aneesh Kumar K.V
Theodore Tso wrote: That is correct. My next step is to enhance the tool to support migration to large inodes. I would actually suggest that the place to add that functionality would be via tune2fs -I inode_size. Since mke2fs -I inode_size is used to set the inode size, it makes sense

Re: [RFC][take 4] e2fsprogs: Add ext4migrate

2007-05-06 Thread Aneesh Kumar K.V
Andreas Dilger wrote: On May 04, 2007 14:43 +0530, Aneesh Kumar K.V wrote: Changes from from my previous patches are as follows: a) support for files with holes b) use the block iterator present in libext2fs c) don't mark the indirect blocks as unused early. If we mark the the blocks

[RFC][take 4] e2fsprogs: Add ext4migrate

2007-05-04 Thread Aneesh Kumar K.V
This is work in progress Changes from from my previous patches are as follows: a) COW unix io manager using libtdb b) add ext4replay to undo the file system changes done during migration Changes from from my previous patches are as follows: a) Mark the file system unclean if we fail migrating

[PATCH 2/4] Add extent related functions

2007-05-04 Thread Aneesh Kumar K.V
From: Aneesh Kumar K.V [EMAIL PROTECTED] The code is derived out of the latest ext4 kernel source. I have tried to keep the code as close as possible to the kernel sources. This makes sure that any fixes for the tree building code in kernel should be easily applied to ext4migrate. The ext3_ext

[PATCH 1/4] Add unix COW io manager

2007-05-04 Thread Aneesh Kumar K.V
From: Aneesh Kumar K.V [EMAIL PROTECTED] Signed-off-by: Aneesh Kumar K.V [EMAIL PROTECTED] --- lib/ext2fs/Makefile.in |6 + lib/ext2fs/ext2_io.h |3 + lib/ext2fs/unix_cow_io.c | 864 ++ 3 files changed, 873 insertions(+), 0 deletions

[PATCH 4/4] Add ext4replay tool.

2007-05-04 Thread Aneesh Kumar K.V
From: Aneesh Kumar K.V [EMAIL PROTECTED] This tool can be used to replay the transactions stored in the database during ext4migrate. Signed-off-by: Aneesh Kumar K.V [EMAIL PROTECTED] --- ext4migrate/Makefile.in |7 ++- ext4migrate/replay.c| 45

[RFC][take 3] e2fsprogs: Add ext4migrate

2007-04-10 Thread Aneesh Kumar K.V
This is work in progress Changes from from my previous patches are as follows: a) Mark the file system unclean if we fail migrating b) support for migrating more than one file c) Support for migrating all the ext3 inode in the file system d) Fix the free block counts. ( Make sure fsck pass

[PATCH 1/2] Add extent related functions

2007-04-10 Thread Aneesh Kumar K.V
From: Aneesh Kumar K.V [EMAIL PROTECTED] The code is derived out of the latest ext4 kernel source. I have tried to keep the code as close as possible to the kernel sources. This makes sure that any fixes for the tree building code in kernel should be easily applied to ext4migrate. The ext3_ext

[PATCH 2/2] e2fsprogs: Add ext4migrate

2007-04-10 Thread Aneesh Kumar K.V
From: Aneesh Kumar K.V [EMAIL PROTECTED] Add ext4migrate utility that helps in migrating a ext3 block mapped inode to ext4 extent mapped inode. ext4migrate command takes the below syntax ext4migrate --display | --migrate image_name [filename] The --display option helps in displaying the block

Re: [RFC][take 2] e2fsprogs: Add ext4migrate

2007-04-04 Thread Aneesh Kumar K.V
Andreas Dilger wrote: On Apr 03, 2007 15:37 +0530, Aneesh Kumar K.V wrote: The extent insert code is derived out of the latest ext4 kernel source. I have tried to keep the code as close as possible to the kernel sources. This makes sure that any fixes for the tree building code in kernel

[PATCH 1/2] Add extent related functions

2007-04-03 Thread Aneesh Kumar K.V
From: Aneesh Kumar K.V [EMAIL PROTECTED] The code is derived out of the latest ext4 kernel source. I have tried to keep the code as close as possible to the kernel sources. This makes sure that any fixes for the tree building code in kernel should be easily applied to ext4migrate. The ext3_ext

[PATCH 2/2] e2fsprogs: Add ext4migrate

2007-04-03 Thread Aneesh Kumar K.V
From: Aneesh Kumar K.V [EMAIL PROTECTED] Add ext4migrate utility that helps in migrating a ext3 block mapped inode to ext4 extent mapped inode. ext4migrate command takes the below syntax ext4migrate [--display | --migrate ] image_name filename The --display option helps in displaying the block

[RFC] e2fsprogs: Add ext4migrate

2007-03-19 Thread Aneesh Kumar K.V
This is work in progress The below patches add ext4migrate utility that helps in migrating a ext3 block mapped inode to ext4 extent mapped inode. I have split the patches into two. They don't build individually. The purpose of splitting the patches into two is to make the review easeir. The

[PATCH 1/2] e2fsprogs: Add ext4migrate

2007-03-19 Thread Aneesh Kumar K.V
From: Aneesh Kumar K.V [EMAIL PROTECTED] Add ext4migrate utility that helps in migrating a ext3 block mapped inode to ext4 extent mapped inode. ext4migrate command takes the below syntax ext4migrate [--display | --migrate ] image_name filename The --display option helps in displaying the block

[PATCH 2/2] Add extent related functions

2007-03-19 Thread Aneesh Kumar K.V
From: Aneesh Kumar K.V [EMAIL PROTECTED] The code is derived out of the latest ext4 kernel source. I have tried to keep the code as close as possible to the kernel sources. This makes sure that any fixes for the tree building code in kernel should be easily applied to ext4migrate. The ext3_ext

<    1   2   3