Re: [RFC] yet another knfsd-reiserfs patch

2001-04-30 Thread Chris Mason
On Monday, April 23, 2001 10:45:14 AM -0400 Chris Mason <[EMAIL PROTECTED]> wrote: > > Hi guys, > > This patch is not meant to replace Neil Brown's knfsd ops stuff, the > goal was to whip up something that had a chance of getting into 2.4.x, > and that might

Re: reiserfs+lndir problem [was: 2.4.4 SMP: spurious EOVERFLOW"Value too large for defined data type"]

2001-05-01 Thread Chris Mason
On Wednesday, May 02, 2001 12:41:52 AM +0200 Daniel Elstner <[EMAIL PROTECTED]> wrote: > Hi, > > On Mon, 30 Apr 2001 21:03:47 -0400 Chris Mason <[EMAIL PROTECTED]> wrote: > >> > Apparently it's a reiserfs/symlink problem. >> > I tried doin

Re: * Re: Severe trashing in 2.4.4

2001-05-01 Thread Chris Mason
On Tuesday, May 01, 2001 03:11:58 PM -0700 David <[EMAIL PROTECTED]> wrote: > Can't say for a definite fact that it was reiserfs but I can say for a > definite fact that something fishy happens sometimes. > > If I have a text file open, something.html comes to mind, If I edit it > and save it

Re: Maximum files per Directory

2001-05-04 Thread Chris Mason
On Tuesday, May 01, 2001 04:57:02 PM -0600 Andreas Dilger <[EMAIL PROTECTED]> wrote: > H. Peter Anvin writes: >> Not correct, there can't be more than 2^15 *directories* in a single >> directory. I belive this is an ext2 limitation. > > > I see that reiserfs plays some tricks with the direct

Re: Maximum files per Directory

2001-05-04 Thread Chris Mason
On Friday, May 04, 2001 01:15:22 PM -0600 Andreas Dilger <[EMAIL PROTECTED]> wrote: > Chris writes: >> On Tuesday, May 01, 2001 04:57:02 PM -0600 Andreas Dilger >> <[EMAIL PROTECTED]> wrote: >> > I see that reiserfs plays some tricks with the directory i_nlink count. >> > If you exceed 64536 li

Re: Maximum files per Directory

2001-05-05 Thread Chris Mason
On Saturday, May 05, 2001 03:49:20 PM +0200 Jamie Lokier <[EMAIL PROTECTED]> wrote: > Chris Mason wrote: >> > Is there a reason that >> > reiserfs chose to have "large number of directories" represented by "1" >> > and not "LINK_MA

Re: 2.2.19 + reiserfs 3.5.32 nfsd wait_on_buffer/down_failed

2001-05-08 Thread Chris Mason
On Tuesday, May 08, 2001 04:42:43 PM +0200 Michael Stiller <[EMAIL PROTECTED]> wrote: > Hi, > > we run a nfs server utilizing 2.2.19 + ReiserFS version 3.5.32 on a > P 3 550 machine. Disk subsystem is a GDT7518RN using 4 UW disks as raid 5 > device. After upgrading from 2.2.17 + reiserfs to 2.

Re: reiserfs, xfs, ext2, ext3

2001-05-11 Thread Chris Mason
On Friday, May 11, 2001 01:39:13 AM +0200 Matthias Andree <[EMAIL PROTECTED]> wrote: > On Thu, 10 May 2001, Hans Reiser wrote: > >> > Hmm... Reiserfs is incompatible with knfsd? That might explain the >> >> we have a patch on our website. > > I'm always wondering why the patch hasn't been m

Re: [reiserfs-dev] Re: reiserfs, xfs, ext2, ext3

2001-05-11 Thread Chris Mason
On Friday, May 11, 2001 12:07:08 PM -0700 Hans Reiser <[EMAIL PROTECTED]> wrote: > "Albert D. Cahalan" wrote: > >> Hans Reiser writes: >> >> > Tell us what to code for, and so long as it doesn't involve looking >> > up files by their 32 bit inode numbers we'll probably be happy to >> > code t

Re: [PATCH] writepage method changes

2001-05-10 Thread Chris Mason
On Wednesday, May 09, 2001 10:51:17 PM -0300 Marcelo Tosatti <[EMAIL PROTECTED]> wrote: > > > On Wed, 9 May 2001, Marcelo Tosatti wrote: > >> Locked for the "not wrote out case" (I will fix my patch now, thanks) > > I just found out that there are filesystems (eg reiserfs) which write out >

Re: [reiserfs-dev] Re: reiserfs, xfs, ext2, ext3

2001-05-13 Thread Chris Mason
On Friday, May 11, 2001 04:00:20 AM -0700 Hans Reiser <[EMAIL PROTECTED]> wrote: > Alan Cox wrote: > >> > Are you referring to Neil Brown's nfs operations patch as being as >> > ugly as hell, or something else? Just want to understand what you are >> > saying before arguing. >> >> Andi h

Re: Reiserfs, Mongo and CPU question

2001-05-15 Thread Chris Mason
On Tuesday, May 15, 2001 01:41:01 PM +0200 Ricardo Galli <[EMAIL PROTECTED]> wrote: > Hans and reiserfs developers, > the same student of my university > (http://www.cs.helsinki.fi/linux/linux-kernel/2001-18/0654.html) was > carrying up the mongo benchmarks against reiser, xfs, jfs and ex

Re: Re[2]: ReiserFS 2.4.4/3.x.0k-pre2

2001-05-15 Thread Chris Mason
On Tuesday, May 15, 2001 02:24:36 PM +0400 Samium Gromoff <[EMAIL PROTECTED]> wrote: > Hello, > I`m still experiencing file tail corruptions > on subj. > And more: after i had restored bblocked patrition > (by relying on drive`s ability to remap bblks on > write by wro

Re: Getting FS access events

2001-05-15 Thread Chris Mason
On Tuesday, May 15, 2001 04:33:57 AM -0400 Alexander Viro <[EMAIL PROTECTED]> wrote: > > > On Tue, 15 May 2001, Linus Torvalds wrote: > >> Looks like there are 19 filesystems that use the buffer cache right now: >> >> grep -l bread fs/*/*.c | cut -d/ -f2 | sort -u | wc >> >> So quite

Re: [patch 4/6][RFC] Attempt to plug race with truncate

2007-10-29 Thread Chris Mason
On Fri, 26 Oct 2007 16:37:36 -0700 Mike Waychison <[EMAIL PROTECTED]> wrote: > Attempt to deal with races with truncate paths. > > I'm not really sure on the locking here, but these seem to be taken > by the truncate path. BKL is left as some filesystem may(?) still > require it. > > Signed-off

Re: [patch 5/6][RFC] Introduce FIBMAP64

2007-10-29 Thread Chris Mason
On Fri, 26 Oct 2007 16:37:37 -0700 Mike Waychison <[EMAIL PROTECTED]> wrote: > Introduce FIBMAP64. This is the same as FIBMAP, but takes a u64. If we're adding new ioctls, I'd rather see the FIEMAP stuff go in, a quick search found discussions but has it died off? -chris - To unsubscribe from t

Re: [patch 0/6][RFC] Cleanup FIBMAP

2007-10-29 Thread Chris Mason
On Sat, 27 Oct 2007 18:57:06 +0100 Anton Altaparmakov <[EMAIL PROTECTED]> wrote: > Hi, > > ->bmap is ugly and horrible! If you have to do this at the very > least please cause ->bmap64 to be able to return error values in case > the file system failed to get the information or indeed such > info

Re: [patch 0/6][RFC] Cleanup FIBMAP

2007-10-29 Thread Chris Mason
On Mon, 29 Oct 2007 12:18:22 -0700 Mike Waychison <[EMAIL PROTECTED]> wrote: > Zach Brown wrote: > >>> And another of my pet peeves with ->bmap is that it uses 0 to > >>> mean "sparse" which causes a conflict on NTFS at least as block > >>> zero is part of the $Boot system file so it is a real, va

[ANNOUNCE] seekwatcher IO graphing v0.2

2007-07-23 Thread Chris Mason
Hello everyone, Since doing the initial Btrfs benchmarks, I've made my blktrace graphing utility a little more generic and tossed it out on oss.oracle.com. This new version can easily graph two different runs, and has a few other tweaks that make the graphs look nicer. Docs, examples and other

[PATCH RFC] extent mapped page cache

2007-07-24 Thread Chris Mason
On Tue, 10 Jul 2007 17:03:26 -0400 Chris Mason <[EMAIL PROTECTED]> wrote: > This patch aims to demonstrate one way to replace buffer heads with a > few extent trees. Buffer heads provide a few different features: > > 1) Mapping of logical file offset to blocks on disk &g

[PATCH RFC] extent mapped page cache main code

2007-07-24 Thread Chris Mason
Core Extentmap implementation diff -r 126111346f94 -r 53cabea328f7 fs/Makefile --- a/fs/Makefile Mon Jul 09 10:53:57 2007 -0400 +++ b/fs/Makefile Tue Jul 24 15:40:27 2007 -0400 @@ -11,7 +11,7 @@ obj-y := open.o read_write.o file_table. attr.o bad_inode.o file.o fil

[PATCH RFC] ext2 extentmap support

2007-07-24 Thread Chris Mason
mount -o extentmap to use the new stuff diff -r 126111346f94 -r 53cabea328f7 fs/ext2/ext2.h --- a/fs/ext2/ext2.hMon Jul 09 10:53:57 2007 -0400 +++ b/fs/ext2/ext2.hTue Jul 24 15:40:27 2007 -0400 @@ -1,5 +1,6 @@ #include #include +#include /* * ext2 mount options @@ -65,6 +66,7 @@

Re: [PATCH RFC] extent mapped page cache

2007-07-24 Thread Chris Mason
On Tue, 24 Jul 2007 23:25:43 +0200 Peter Zijlstra <[EMAIL PROTECTED]> wrote: > On Tue, 2007-07-24 at 16:13 -0400, Trond Myklebust wrote: > > On Tue, 2007-07-24 at 16:00 -0400, Chris Mason wrote: > > > On Tue, 10 Jul 2007 17:03:26 -0400 > > > Chri

Re: [PATCH RFC] extent mapped page cache

2007-07-25 Thread Chris Mason
On Wed, 25 Jul 2007 04:32:17 +0200 Nick Piggin <[EMAIL PROTECTED]> wrote: > On Tue, Jul 24, 2007 at 07:25:09PM -0400, Chris Mason wrote: > > On Tue, 24 Jul 2007 23:25:43 +0200 > > Peter Zijlstra <[EMAIL PROTECTED]> wrote: > > > > The tree is a critica

Re: [PATCH RFC] extent mapped page cache

2007-07-25 Thread Chris Mason
On Thu, 26 Jul 2007 03:37:28 +0200 Nick Piggin <[EMAIL PROTECTED]> wrote: > > > One advantage to the state tree is that it separates the state from > > the memory being described, allowing a simple kmap style interface > > that covers subpages, highmem and superpages. > > I suppose so, although

Re: [PATCH RFC] extent mapped page cache

2007-07-26 Thread Chris Mason
On Thu, 26 Jul 2007 04:36:39 +0200 Nick Piggin <[EMAIL PROTECTED]> wrote: [ are state trees a good idea? ] > > One thing it gains us is finding the start of the cluster. Even if > > called by kswapd, the state tree allows writepage to find the start > > of the cluster and send down a big bio (pr

Re: [PATCH 0/6] writeback time order/delay fixes take 3

2007-08-28 Thread Chris Mason
: > > > > On Tue, Aug 21, 2007 at 08:23:14PM -0400, Chris Mason wrote: > > > > Notes: > > > > (1) I'm not sure inode number is correlated to disk location in > > > > filesystems other than ext2/3/4. Or parent dir? > > > > &

Re: [PATCH 0/6] writeback time order/delay fixes take 3

2007-08-28 Thread Chris Mason
On Wed, 29 Aug 2007 02:33:08 +1000 David Chinner <[EMAIL PROTECTED]> wrote: > On Tue, Aug 28, 2007 at 11:08:20AM -0400, Chris Mason wrote: > > > > > > > > I wonder if XFS can benefit any more from the general writeback > > > > cluster

Re: [PATCH 00/23] per device dirty throttling -v8

2007-08-06 Thread Chris Mason
On Sun, 5 Aug 2007 11:00:29 -0400 Theodore Tso <[EMAIL PROTECTED]> wrote: > On Sun, Aug 05, 2007 at 02:26:53AM +0200, Andi Kleen wrote: > > I always thought the right solution would be to just sync atime only > > very very lazily. This means if a inode is only dirty because of an > > atime update

[ANNOUNCE] seekwatcher v0.3 IO graphing an animation

2007-07-27 Thread Chris Mason
Hello everyone, I've tossed out seekwatcher v0.3. The major changes are using rolling averages to smooth out the seek and throughput graphs, and it can generate mpgs of the IO done by a given trace. Here's a sample of the smoother graphs (creating 20 kernel trees): http://oss.oracle.com/~mason

Re: [PATCH] rd: Use a private inode for backing storage

2007-10-22 Thread Chris Mason
On Sun, 21 Oct 2007 12:39:30 -0600 [EMAIL PROTECTED] (Eric W. Biederman) wrote: > Nick Piggin <[EMAIL PROTECTED]> writes: > > > On Sunday 21 October 2007 18:23, Eric W. Biederman wrote: > >> Christian Borntraeger <[EMAIL PROTECTED]> writes: > > > >> Let me put it another way. Looking at /proc/sl

Re: [PATCH] reiserfs: don't drop PG_dirty when releasing sub-page-sized dirty file

2007-10-23 Thread Chris Mason
On Tue, 23 Oct 2007 19:56:20 +0800 Fengguang Wu <[EMAIL PROTECTED]> wrote: > On Tue, Oct 23, 2007 at 12:07:07PM +0200, Peter Zijlstra wrote: > > [ adding reiserfs devs to the CC ] > > Thank you. > > This fix is kind of crude - even when it fixed Maxim's problem, and > survived my stress testing

[CFP] 2008 Linux Storage and Filesystem Workshop

2007-10-24 Thread Chris Mason
Hello everyone, We are organizing another filesystem and storage workshop in San Jose next Feb 25 and 26. You can find some great writeups of last year's conference on LWN: http://lwn.net/Articles/226351/ This year we're trying to concentrate on more problem solving sessions, short term projec

More Large blocksize benchmarks

2007-10-15 Thread Chris Mason
Hello everyone, I'm stealing the cc list and reviving and old thread because I've finally got some numbers to go along with the Btrfs variable blocksize feature. The basic idea is to create a read/write interface to map a range of bytes on the address space, and use it in Btrfs for all metadata o

Re: More Large blocksize benchmarks

2007-10-16 Thread Chris Mason
On Tue, 2007-10-16 at 12:36 +1000, David Chinner wrote: > On Mon, Oct 15, 2007 at 08:22:31PM -0400, Chris Mason wrote: > > Hello everyone, > > > > I'm stealing the cc list and reviving and old thread because I've > > finally got some numbers to go al

Re: [PATCH] rd: Mark ramdisk buffers heads dirty

2007-10-17 Thread Chris Mason
On Wed, 2007-10-17 at 11:57 -0600, Eric W. Biederman wrote: > Christian Borntraeger <[EMAIL PROTECTED]> writes: > > > Eric, > > > > Am Dienstag, 16. Oktober 2007 schrieb Christian Borntraeger: > >> Am Dienstag, 16. Oktober 2007 schrieb Eric W. Biederman: > >> > >> > fs/buffer.c |3 +++ > >> >

Re: [PATCH] rd: Mark ramdisk buffers heads dirty

2007-10-17 Thread Chris Mason
On Wed, 2007-10-17 at 14:29 -0600, Eric W. Biederman wrote: > Chris Mason <[EMAIL PROTECTED]> writes: > > > In this case, the commit block isn't allowed to be dirty before reiserfs > > decides it is safe to write it. The journal code expects it is the only > >

Re: [PATCH] rd: Mark ramdisk buffers heads dirty

2007-10-17 Thread Chris Mason
On Wed, 2007-10-17 at 15:30 -0600, Eric W. Biederman wrote: > Chris Mason <[EMAIL PROTECTED]> writes: > > >> Thinking about it. I don't believe anyone has ever intentionally built > >> a filesystem tool that depends on being able to modify a file systems &

Re: [PATCH] rd: Mark ramdisk buffers heads dirty

2007-10-17 Thread Chris Mason
On Wed, 2007-10-17 at 17:28 -0600, Eric W. Biederman wrote: > Chris Mason <[EMAIL PROTECTED]> writes: > > > So, the problem is using the Dirty bit to indicate pinned. You're > > completely right that our current setup of buffer heads and pages and > >

2008 Linux Storage and Filesystem Workshop

2007-11-05 Thread Chris Mason
Hello everyone, The position statement submission system for the 2008 storage and filesystem workshop is now online. This is how you let us know you're interested in attending and what topics are most important for discussion. For all the details, please see: http://www.usenix.org/events/lsf08

Re: dio_get_page() lockdep complaints

2007-11-09 Thread Chris Mason
On Fri, 09 Nov 2007 09:48:22 -0800 Zach Brown <[EMAIL PROTECTED]> wrote: > > >> So reiser and NFS need to be fixed. No? > > > > Actually, it is rather mmap() needs to be fixed. > > Sure, I'm willing to have that demonstrated. My point was that DIO > getting the mmap_sem inside i_mutex is curr

Re: dio_get_page() lockdep complaints

2007-11-09 Thread Chris Mason
On Fri, 09 Nov 2007 10:35:04 -0800 Zach Brown <[EMAIL PROTECTED]> wrote: > > Without getting into a huge patch, the best fix would just be > > switching to try lock. If the tail doesn't get packed, the world > > doesn't end. > > So, something like

Re: dio_get_page() lockdep complaints

2007-11-09 Thread Chris Mason
On Fri, 9 Nov 2007 13:53:27 -0500 Chris Mason <[EMAIL PROTECTED]> wrote: > On Fri, 09 Nov 2007 10:35:04 -0800 > Zach Brown <[EMAIL PROTECTED]> wrote: > > > > Without getting into a huge patch, the best fix would just be > > > switching to try lock. If

Re: dio_get_page() lockdep complaints

2007-11-09 Thread Chris Mason
On Fri, 09 Nov 2007 11:16:53 -0800 Zach Brown <[EMAIL PROTECTED]> wrote: > > Ugh, I thought the preallocation was getting freed elsewhere, but it > > looks like I was wrong. We can't just skip the i_mutex after all, > > sorry. > > Ah, so none of those tests at the top will stop tail packing if >

Re: dirty balancing deadlock

2007-02-18 Thread Chris Mason
On Mon, Feb 19, 2007 at 01:25:21AM +0100, Miklos Szeredi wrote: > > > > If so, writes to B will decrease the dirty memory threshold. > > > > > > Yes, but not by enough. Say A dirties a 1100 pages, limit is 1000. > > > Some pages queued for writeback (doesn't matter how much). B writes > > > back

Re: dirty balancing deadlock

2007-02-18 Thread Chris Mason
On Mon, Feb 19, 2007 at 01:54:31AM +0100, Miklos Szeredi wrote: > > > > > > If so, writes to B will decrease the dirty memory threshold. > > > > > > > > > > Yes, but not by enough. Say A dirties a 1100 pages, limit is 1000. > > > > > Some pages queued for writeback (doesn't matter how much). B w

Re: [PATCH] aio: propogate post-EIOCBQUEUED errors to completion event

2007-02-19 Thread Chris Mason
On Mon, Feb 19, 2007 at 11:58:16PM +0300, Ananiev, Leonid I wrote: > > while triggering EIO in invalidate_inode_pages2_range() > ... > > With this patch aio-stress sees -EIO. > > Actually if invalidate_inode_pages2_range() returns EIO it means > that internal kernel synchronization conflict was h

Re: dirty balancing deadlock

2007-02-19 Thread Chris Mason
On Mon, Feb 19, 2007 at 06:11:55PM +0100, Miklos Szeredi wrote: > How about this? > > Solves the FUSE deadlock, but not the throttle_vm_writeout() one. > I'll try to tackle that one as well. > > If the per-bdi dirty counter goes below 16, balance_dirty_pages() > returns. > > Does the constant ne

Re: dirty balancing deadlock

2007-02-19 Thread Chris Mason
On Mon, Feb 19, 2007 at 02:14:15AM +0100, Miklos Szeredi wrote: > > > > In general, writepage is supposed to do work without blocking on > > > > expensive locks that will get pdflush and dirty reclaim stuck in this > > > > fashion. You'll probably have to take the same approach reiserfs does > > >

Re: [PATCH] aio: propogate post-EIOCBQUEUED errors to completion event

2007-02-19 Thread Chris Mason
On Mon, Feb 19, 2007 at 07:21:09PM -0500, Benjamin LaHaise wrote: > On Mon, Feb 19, 2007 at 04:50:48PM -0500, Chris Mason wrote: > > aio is not responsible for this particular synchronization. Those fixes > > (if we make them) should come from other places. The patch is important

Re: dirty balancing deadlock

2007-02-20 Thread Chris Mason
On Tue, Feb 20, 2007 at 09:47:11AM +0100, Miklos Szeredi wrote: > > > How about this? > > > > > > Solves the FUSE deadlock, but not the throttle_vm_writeout() one. > > > I'll try to tackle that one as well. > > > > > > If the per-bdi dirty counter goes below 16, balance_dirty_pages() > > > return

Re: [PATCH] aio: propogate post-EIOCBQUEUED errors to completion event

2007-02-20 Thread Chris Mason
On Tue, Feb 20, 2007 at 11:01:50AM -0500, Trond Myklebust wrote: > On Mon, 2007-02-19 at 19:21 -0500, Benjamin LaHaise wrote: > > On Mon, Feb 19, 2007 at 04:50:48PM -0500, Chris Mason wrote: > > > aio is not responsible for this particular synchronization. Those fixes >

Re: [PATCH] aio: propogate post-EIOCBQUEUED errors to completion event

2007-02-20 Thread Chris Mason
On Tue, Feb 20, 2007 at 05:06:47PM +0100, Arjan van de Ven wrote: > > We don't try to resolve "conflicting" writes between ordinary mmap() and > > write(), so why should we be doing it for mmap and O_DIRECT? > > > > mmap() is designed to violate the ordinary mutex locks for write(), so > > if a co

Re: [PATCH 2/2] aio: propogate post-EIOCBQUEUED errors to completion event

2007-02-20 Thread Chris Mason
On Tue, Feb 20, 2007 at 07:57:49PM +0300, Ananiev, Leonid I wrote: > Zach> This addresses an oops reported by Leonid Ananiev > <[EMAIL PROTECTED]> > Zach> as archived at http://lkml.org/lkml/2007/2/8/337. > > Zach> This was tested by running O_DIRECT aio-stress concurrently with > buffered rea

Re: [PATCH 2/2] aio: propogate post-EIOCBQUEUED errors to completion event

2007-02-20 Thread Chris Mason
On Tue, Feb 20, 2007 at 08:17:51PM +0300, Ananiev, Leonid I wrote: > aio-stress command lines used for test > 1) mem=1G in kernel boot param if you have more > 2) mk2fs for test_file > 3) dd if=/dev/zero of= bs=1M count=1200 > 4) aiostress -s 1200m -o 2 -i 1 -r 16k > Sorry, this aio-stress comma

Re: O_DIRECT question

2007-01-12 Thread Chris Mason
On Fri, Jan 12, 2007 at 10:06:22AM -0800, Linus Torvalds wrote: > > looking at the splice(2) api it seems like it'll be difficult to implement > > O_DIRECT pread/pwrite from userland using splice... so there'd need to be > > some help there. > > You'd use vmsplice() to put the write buffers int

Re: [rfc patch] optimize o_direct on block device

2006-12-01 Thread Chris Mason
On Thu, Nov 30, 2006 at 10:16:53PM -0800, Chen, Kenneth W wrote: > Zach Brown wrote on Thursday, November 30, 2006 1:45 PM > > > At that time, a patch was written for raw device to demonstrate that > > > large performance head room is achievable (at ~20% speedup for micro- > > > benchmark and ~2% f

Re: [ANNOUNCE] Btrfs: a copy on write, snapshotting FS

2007-06-18 Thread Chris Mason
On Tue, Jun 12, 2007 at 12:10:29PM -0400, Chris Mason wrote: > Hello everyone, > > After the last FS summit, I started working on a new filesystem that > maintains checksums of all file data and metadata. Many thanks to Zach > Brown for his ideas, and to Dave Chinner

Re: Versioning file system

2007-06-18 Thread Chris Mason
On Mon, Jun 18, 2007 at 03:45:24AM -0600, Andreas Dilger wrote: > Too bad everyone is spending time on 10 similar-but-slightly-different > filesystems. This will likely end up with a bunch of filesystems that > implement some easy subset of features, but will not get polished for > users or have a

Updated Btrfs project site online

2007-06-18 Thread Chris Mason
Hello everyone, I've moved the Btrfs pages here: http://oss.oracle.com/projects/btrfs Which gives us a bugzilla, mailing lists, and a somewhat more orderly file download area. There are links to my HG trees for sources as well. The oss project area automagically creates a few different mailin

Re: Updated Btrfs project site online -git repo?

2007-06-18 Thread Chris Mason
On Mon, Jun 18, 2007 at 09:53:39PM +0200, Maria Domenica Bertolucci wrote: > Would it be possible to have a git repo as well so as to keep in sync > with all git kernel projects? It also helps standardize things. Sorry, the repos will stay Mercurial based for now. These are small repos and not at

Re: [ANNOUNCE] Btrfs: a copy on write, snapshotting FS

2007-06-19 Thread Chris Mason
On Tue, Jun 19, 2007 at 10:11:13AM +0100, Pádraig Brady wrote: > Vladislav Bolkhovitin wrote: > > > > I would also suggest one more feature: support for block level > > de-duplication. I mean: > > > > 1. Ability for Btrfs to have blocks in several files to point to the > > same block on disk > >

Re: [AppArmor 39/45] AppArmor: Profile loading and manipulation, pathname matching

2007-06-21 Thread Chris Mason
On Thu, Jun 21, 2007 at 04:59:54PM -0400, Stephen Smalley wrote: > On Thu, 2007-06-21 at 21:54 +0200, Lars Marowsky-Bree wrote: > > On 2007-06-21T15:42:28, James Morris <[EMAIL PROTECTED]> wrote: > > > > > > A veto is not a technical argument. All technical arguments (except for > > > > "path name

Re: [AppArmor 39/45] AppArmor: Profile loading and manipulation, pathname matching

2007-06-22 Thread Chris Mason
On Thu, Jun 21, 2007 at 09:06:40PM -0400, James Morris wrote: > On Thu, 21 Jun 2007, Chris Mason wrote: > > > > The incomplete mediation flows from the design, since the pathname-based > > > mediation doesn't generalize to cover all objects unlike label- or > >

Re: [AppArmor 39/45] AppArmor: Profile loading and manipulation, pathname matching

2007-06-22 Thread Chris Mason
On Fri, Jun 22, 2007 at 09:48:12AM -0400, James Morris wrote: > On Fri, 22 Jun 2007, Chris Mason wrote: > > > > The validity or otherwise of pathname access control is not being > > > discussed here. > > > > > > The point is that the pa

Re: [AppArmor 39/45] AppArmor: Profile loading and manipulation, pathname matching

2007-06-22 Thread Chris Mason
On Fri, Jun 22, 2007 at 10:23:03AM -0400, James Morris wrote: > On Fri, 22 Jun 2007, Chris Mason wrote: > > > But, this is a completely different discussion than if AA is > > solving problems in the wild for its intended audience, or if the code > > is somehow flawed and

Re: [RFC] fsblock

2007-06-24 Thread Chris Mason
On Sun, Jun 24, 2007 at 05:47:55AM +0200, Nick Piggin wrote: > On Sat, Jun 23, 2007 at 11:07:54PM -0400, Jeff Garzik wrote: > > > >- Large block support. I can mount and run an 8K block size minix3 fs on > > > my 4K page system and it didn't require anything special in the fs. We > > > can go up

Re: [RFC] fsblock

2007-06-25 Thread Chris Mason
On Mon, Jun 25, 2007 at 04:58:48PM +1000, Nick Piggin wrote: > > >Using buffer heads instead allows the FS to send file data down inside > >the transaction code, without taking the page lock. So, locking wrt > >data=ordered is definitely going to be tricky. > > > >The best long term option may be

Re: [patch 1/3] add the fsblock layer

2007-06-25 Thread Chris Mason
On Mon, Jun 25, 2007 at 05:41:58PM +1000, Nick Piggin wrote: > Neil Brown wrote: > >On Sunday June 24, [EMAIL PROTECTED] wrote: > > > >> > >>+#define PG_blocks 20 /* Page has block mappings */ > >>+ > > > > > >I've only had a very quick look, but this line looks *very* wrong. > >You s

Re: [patch 1/3] add the fsblock layer

2007-06-25 Thread Chris Mason
On Sun, Jun 24, 2007 at 03:46:13AM +0200, Nick Piggin wrote: > Rewrite the buffer layer. Overall, I like the basic concepts, but it is hard to track the locking rules. Could you please write them up? I like the way you split out the assoc_buffers from the main fsblock code, but the list setup is

Re: [patch 1/3] add the fsblock layer

2007-06-26 Thread Chris Mason
On Tue, Jun 26, 2007 at 01:07:43PM +1000, Nick Piggin wrote: > Neil Brown wrote: > >On Tuesday June 26, [EMAIL PROTECTED] wrote: > > > >>Chris Mason wrote: > >> > >>>The block device pagecache isn't special, and certainly isn't that much >

Re: [RFC] fsblock

2007-06-26 Thread Chris Mason
On Tue, Jun 26, 2007 at 07:23:09PM +1000, David Chinner wrote: > On Tue, Jun 26, 2007 at 01:55:11PM +1000, Nick Piggin wrote: [ ... fsblocks vs extent range mapping ] > iomaps can double as range locks simply because iomaps are > expressions of ranges within the file. Seeing as you can only > ac

Re: vm/fs meetup in september?

2007-06-26 Thread Chris Mason
On Tue, Jun 26, 2007 at 12:35:09PM +1000, Nick Piggin wrote: > Christoph Hellwig wrote: > >On Sun, Jun 24, 2007 at 06:23:45AM +0200, Nick Piggin wrote: > > > >>I'd just like to take the chance also to ask about a VM/FS meetup some > >>time around kernel summit (maybe take a big of time during UKUUG

[ANNOUNCE] Btrfs: a copy on write, snapshotting FS

2007-06-12 Thread Chris Mason
Hello everyone, After the last FS summit, I started working on a new filesystem that maintains checksums of all file data and metadata. Many thanks to Zach Brown for his ideas, and to Dave Chinner for his help on benchmarking analysis. The basic list of features looks like this: * Exte

Re: [ANNOUNCE] Btrfs: a copy on write, snapshotting FS

2007-06-12 Thread Chris Mason
On Tue, Jun 12, 2007 at 03:53:03PM -0400, Mike Snitzer wrote: > On 6/12/07, Chris Mason <[EMAIL PROTECTED]> wrote: > >Hello everyone, > > > >After the last FS summit, I started working on a new filesystem that > >maintains checksums of all file data and metadata.

Re: [ANNOUNCE] Btrfs: a copy on write, snapshotting FS

2007-06-13 Thread Chris Mason
On Wed, Jun 13, 2007 at 04:08:30AM +0100, Christoph Hellwig wrote: > On Tue, Jun 12, 2007 at 04:14:39PM -0400, Chris Mason wrote: > > > Aside from folding snapshot history into the origin's namespace... It > > > could be possible to have a mount.btrfs that allows subvol

Re: [ANNOUNCE] Btrfs: a copy on write, snapshotting FS

2007-06-13 Thread Chris Mason
On Tue, Jun 12, 2007 at 11:46:20PM -0400, John Stoffel wrote: > >>>>> "Chris" == Chris Mason <[EMAIL PROTECTED]> writes: > > Chris> After the last FS summit, I started working on a new filesystem > Chris> that maintains checksums of all file data

Re: [ANNOUNCE] Btrfs: a copy on write, snapshotting FS

2007-06-13 Thread Chris Mason
On Wed, Jun 13, 2007 at 01:45:28AM -0400, Albert Cahalan wrote: > Neat! It's great to see somebody else waking up to the idea that > storage media is NOT to be trusted. > > Judging by the design paper, it looks like your structs have some > alignment problems. Actual defs are all packed, but I ma

Re: [ANNOUNCE] Btrfs: a copy on write, snapshotting FS

2007-06-13 Thread Chris Mason
On Wed, Jun 13, 2007 at 10:00:56AM -0400, John Stoffel wrote: > >>>>> "Chris" == Chris Mason <[EMAIL PROTECTED]> writes: > >> As a user of Netapps, having quotas (if only for reporting purposes) > >> and some way to migrate non-used files to sl

Re: [ANNOUNCE] Btrfs: a copy on write, snapshotting FS

2007-06-13 Thread Chris Mason
On Wed, Jun 13, 2007 at 12:12:23PM -0400, John Stoffel wrote: > >>>>> "Chris" == Chris Mason <[EMAIL PROTECTED]> writes: [ nod ] > Also, I think you're wrong here when you state that making a snapshot > (sub-volume?) RO just requires you to set the

Re: [ANNOUNCE] Btrfs: a copy on write, snapshotting FS

2007-06-13 Thread Chris Mason
On Wed, Jun 13, 2007 at 12:14:40PM -0400, Albert Cahalan wrote: > On 6/13/07, Chris Mason <[EMAIL PROTECTED]> wrote: > >On Wed, Jun 13, 2007 at 01:45:28AM -0400, Albert Cahalan wrote: > > >> The usual wishlist: > >> > >> * inode-to-pathnames mapping

Re: [ANNOUNCE] Btrfs: a copy on write, snapshotting FS

2007-06-14 Thread Chris Mason
On Thu, Jun 14, 2007 at 02:59:23AM -0400, Albert Cahalan wrote: > On 6/13/07, Chris Mason <[EMAIL PROTECTED]> wrote: [ secure deletion in btrfs ] > > > >Right about here is where I would insert a long story about ecryptfs, or > >encryption solutions that happen all in

Re: [ANNOUNCE] Btrfs: a copy on write, snapshotting FS

2007-06-14 Thread Chris Mason
On Thu, Jun 14, 2007 at 02:20:26PM -0400, Chuck Lever wrote: > Hi Chris- > > John Stoffel wrote: > >As a user of Netapps, having quotas (if only for reporting purposes) > >and some way to migrate non-used files to slower/cheaper storage would > >be great. > > > >Ie. being able to setup two pools,

[PATCH RFC] extent mapped page cache

2007-07-10 Thread Chris Mason
This patch aims to demonstrate one way to replace buffer heads with a few extent trees. Buffer heads provide a few different features: 1) Mapping of logical file offset to blocks on disk 2) Recording state (dirty, locked etc) 3) Providing a mechanism to access sub-page sized blocks. This patch c

Re: [PATCH RFC] extent mapped page cache

2007-07-18 Thread Chris Mason
On Thu, 12 Jul 2007 00:00:28 -0700 Daniel Phillips <[EMAIL PROTECTED]> wrote: > On Tuesday 10 July 2007 14:03, Chris Mason wrote: > > This patch aims to demonstrate one way to replace buffer heads with > > a few extent trees... > > Hi Chris, > > Quite terse

Re: [PATCH 1 of 2] block_page_mkwrite() Implementation V2

2007-05-16 Thread Chris Mason
On Wed, May 16, 2007 at 08:09:19PM +0800, David Woodhouse wrote: > On Wed, 2007-05-16 at 11:19 +0100, David Howells wrote: > > The start and end points passed to block_prepare_write() delimit the region > > of > > the page that is going to be modified. This means that prepare_write() > > doesn't

Re: [PATCH 1 of 2] block_page_mkwrite() Implementation V2

2007-05-16 Thread Chris Mason
On Wed, May 16, 2007 at 11:04:11PM +1000, Nick Piggin wrote: > Chris Mason wrote: > >On Wed, May 16, 2007 at 08:09:19PM +0800, David Woodhouse wrote: > > > >>On Wed, 2007-05-16 at 11:19 +0100, David Howells wrote: > >> > >>>The start and end point

filesystem benchmarking fun

2007-05-16 Thread Chris Mason
Hello everyone, I've been spending some time lately on filesystem benchmarking, in part because my pet FS project is getting more stable and closer to release. Now seems like a good time to step back and try to find out what workloads we think are most important and see how well Linux is doing on

Re: filesystem benchmarking fun

2007-05-16 Thread Chris Mason
On Wed, May 16, 2007 at 12:01:06PM -0400, Chuck Ebbert wrote: > Chris Mason wrote: > > For example, I'll pick on xfs for a minute. compilebench shows the > > default FS you get from mkfs.xfs is pretty slow for untarring a > > bunch of kernel trees. Dave Chinner gave

Re: filesystem benchmarking fun

2007-05-16 Thread Chris Mason
On Wed, May 16, 2007 at 11:25:15AM -0700, Andrew Morton wrote: > On Wed, 16 May 2007 13:11:56 -0400 > Chris Mason <[EMAIL PROTECTED]> wrote: > > > At least on ext3, it may help to sort the blocks under io for > > flushing...it may not. A bigger log would definitely he

Re: filesystem benchmarking fun

2007-05-16 Thread Chris Mason
On Wed, May 16, 2007 at 08:12:09PM +0200, Jan Engelhardt wrote: > > On May 16 2007 10:42, Chris Mason wrote: > > > >For example, I'll pick on xfs for a minute. compilebench shows the > >default FS you get from mkfs.xfs is pretty slow for untarring a bunch of > &

Re: filesystem benchmarking fun

2007-05-16 Thread Chris Mason
On Wed, May 16, 2007 at 12:33:42PM -0700, Andrew Morton wrote: > On Wed, 16 May 2007 15:13:39 -0400 > Chris Mason <[EMAIL PROTECTED]> wrote: > > > > > > > If that's still working then the problem will _probably_ be directory > > > writeout. Po

Re: filesystem benchmarking fun

2007-05-16 Thread Chris Mason
On Wed, May 16, 2007 at 01:04:13PM -0700, Andrew Morton wrote: > > The good news is that if you let it run long enough, the times > > stabilize. The bad news is: > > > > create dir kernel-86 222MB in 15.85 seconds (14.03 MB/s) > > create dir kernel-87 222MB in 28.67 seconds (7.76 MB/s) > > create

Re: filesystem benchmarking fun

2007-05-16 Thread Chris Mason
On Wed, May 16, 2007 at 01:37:26PM -0700, Andrew Morton wrote: > On Wed, 16 May 2007 16:14:14 -0400 > Chris Mason <[EMAIL PROTECTED]> wrote: > > > On Wed, May 16, 2007 at 01:04:13PM -0700, Andrew Morton wrote: > > > > The good news is that if you

Re: [RFC] fsblock

2007-06-27 Thread Chris Mason
On Wed, Jun 27, 2007 at 07:32:45AM +0200, Nick Piggin wrote: > On Tue, Jun 26, 2007 at 08:34:49AM -0400, Chris Mason wrote: > > On Tue, Jun 26, 2007 at 07:23:09PM +1000, David Chinner wrote: > > > On Tue, Jun 26, 2007 at 01:55:11PM +1000, Nick Piggin wrote: > > > >

Re: [RFC] fsblock

2007-06-28 Thread Chris Mason
On Thu, Jun 28, 2007 at 04:44:43AM +0200, Nick Piggin wrote: > On Thu, Jun 28, 2007 at 08:35:48AM +1000, David Chinner wrote: > > On Wed, Jun 27, 2007 at 07:50:56AM -0400, Chris Mason wrote: > > > Lets look at a typical example of how IO actually gets done today, > > &

Re: how do versioning filesystems take snapshot of opened files?

2007-07-03 Thread Chris Mason
On Tue, 3 Jul 2007 01:28:57 -0400 "Xin Zhao" <[EMAIL PROTECTED]> wrote: > Hi, > > > If a file is already opened when snapshot command is issued, the file > itself could be in an inconsistent state already. Before the file is > closed, maybe part of the file contains old data, the rest contains

Re: Versioning file system

2007-07-05 Thread Chris Mason
On Thu, 5 Jul 2007 09:57:40 -0400 "John Stoffel" <[EMAIL PROTECTED]> wrote: > > "Erik" == Erik Mouw <[EMAIL PROTECTED]> writes: > > Erik> (sorry for the late reply, just got back from holiday) > Erik> On Mon, Jun 18, 2007 at 01:29:56PM -0400, Theodore Tso wrote: > >> As I mentioned in my Linu

Re: filesystem benchmarking fun

2007-05-22 Thread Chris Mason
On Wed, May 16, 2007 at 01:37:26PM -0700, Andrew Morton wrote: > On Wed, 16 May 2007 16:14:14 -0400 > Chris Mason <[EMAIL PROTECTED]> wrote: > > > On Wed, May 16, 2007 at 01:04:13PM -0700, Andrew Morton wrote: > > > > The good news is that if you

Re: filesystem benchmarking fun

2007-05-22 Thread Chris Mason
On Tue, May 22, 2007 at 01:50:13PM -0400, John Stoffel wrote: > >>>>> "Chris" == Chris Mason <[EMAIL PROTECTED]> writes: > > Chris> On Wed, May 16, 2007 at 01:37:26PM -0700, Andrew Morton wrote: [ seeky writes while creating kernel trees on ext3 ]

<    1   2   3   4   5   6   7   8   >