Re: Poor performance unlinking hard-linked files (repost)

2010-11-30 Thread Bron Gondwana
On Tue, Nov 30, 2010 at 07:49:26AM -0500, Chris Mason wrote: > Excerpts from Bron Gondwana's message of 2010-11-30 04:35:10 -0500: > > Do you have any suggestsions for what I could try? You mentioned READ_SYNC > > above. We now have one working partition on this machine, but it took > > longer >

Re: Poor performance unlinking hard-linked files (repost)

2010-11-30 Thread Bron Gondwana
On Sat, Nov 20, 2010 at 08:58:10AM +1100, Bron Gondwana wrote: > On Fri, Nov 19, 2010 at 09:10:08AM -0500, Chris Mason wrote: > > Excerpts from Bron Gondwana's message of 2010-11-18 16:46:31 -0500: > > > On Thu, Nov 18, 2010 at 10:30:47AM -0500, Chris Mason wrote: > >

Re: Poor performance unlinking hard-linked files (repost)

2010-11-19 Thread Bron Gondwana
On Fri, Nov 19, 2010 at 09:10:08AM -0500, Chris Mason wrote: > Excerpts from Bron Gondwana's message of 2010-11-18 16:46:31 -0500: > > On Thu, Nov 18, 2010 at 10:30:47AM -0500, Chris Mason wrote: > > > > http://pastebin.com/Tg7agv42 > > > > > > Ok, we're mixing unlinks and fsyncs. If it fsyncing

Re: Poor performance unlinking hard-linked files (repost)

2010-11-18 Thread Bron Gondwana
On Thu, Nov 18, 2010 at 10:30:47AM -0500, Chris Mason wrote: > Excerpts from Bron Gondwana's message of 2010-11-16 23:11:48 -0500: > > > > a) program creates piles of small temporary files, hard > > > >links them out to different directories, unlinks the > > > >originals. > > > > > > > > b

Re: Poor performance unlinking hard-linked files (repost)

2010-11-17 Thread Bron Gondwana
On Wed, Nov 17, 2010 at 03:11:48PM +1100, Bron Gondwana wrote: > > Could you sysrq-w while the performance is bad? That would narrow it > > down. > > Here's one: > > http://pastebin.com/Tg7agv42 And here's another one, inline this time. The iostat for 10 se

Re: Poor performance unlinking hard-linked files (repost)

2010-11-16 Thread Bron Gondwana
On Tue, Nov 16, 2010 at 08:38:13AM -0500, Chris Mason wrote: > Excerpts from Bron Gondwana's message of 2010-11-16 07:54:45 -0500: > > Just posting this again more neatly formatted and just the > > 'meat': > > > > a) program creates piles of small temporary files, hard > >links them out to dif

Poor performance unlinking hard-linked files (repost)

2010-11-16 Thread Bron Gondwana
Just posting this again more neatly formatted and just the 'meat': a) program creates piles of small temporary files, hard links them out to different directories, unlinks the originals. b) filesystem size: ~ 300Gb (backed by hardware RAID5) c) as the filesystem grows (currently about 30%

Poor performance unlinking hard-linked files

2010-11-12 Thread Bron Gondwana
bad as an initial sync, but lmtp delivery uses the same method - spool to staging file, parse it there, then symlink to all the delivery targets before unlinking the original. Thanks, Bron. -- Bron Gondwana br...@fastmail.fm -- To unsubscribe from this list: send the line "uns

Re: grub-0.97: btrfs multidevice support [PATCH]

2009-09-25 Thread Bron Gondwana
On Fri, Sep 25, 2009 at 04:01:36PM +0100, Colin Watson wrote: > On Fri, Sep 25, 2009 at 04:09:51PM +0200, Robert Millan wrote: > > On Fri, Sep 25, 2009 at 08:38:10AM +1000, Bron Gondwana wrote: > > > On Thu, Sep 24, 2009 at 10:21:46PM +0200, Robert Millan wrote: > > >

Re: grub-0.97: btrfs multidevice support [PATCH]

2009-09-24 Thread Bron Gondwana
On Thu, Sep 24, 2009 at 10:21:46PM +0200, Robert Millan wrote: > > Hi Edward, > > I'm sorry but GRUB Legacy is not maintained. At least not by us; we've > deprecated it in favour of GRUB 2. > > It is also being abandoned by distributors, so I wouldn't recommend that you > put any effort in dev

Re: Single disk performance

2009-06-29 Thread Bron Gondwana
On Mon, Jun 29, 2009 at 08:41:49AM -0400, Chris Mason wrote: > On Fri, Jun 26, 2009 at 09:26:59PM -0500, Steven Pratt wrote: > > 18:40:32 btrfs2 kernel: [ 4459.870613] sd 0:0:1:0: [sdb] Unhandled error > > code > > Jun 26 18:40:32 btrfs2 kernel: [ 4459.870640] sd 0:0:1:0: [sdb] Result: > > hostb

Re: Phoronix article slaming BTRFS

2009-06-24 Thread Bron Gondwana
On Wed, Jun 24, 2009 at 12:57:40PM +, Mike Ramsey wrote: > Bron Gondwana fastmail.fm> writes: > > Meaning that nobody can turn off the write cache in linux without deep > > kernel > > hackery. > > I would say this differently. "Meaning that nobody can tur

Re: Phoronix article slaming BTRFS

2009-06-24 Thread Bron Gondwana
e trying to run it in production. I.e. they're benchmarking reality. Sure there are ways that btrfs performance could be improved, but they're not realistically available to mortals selecting "use btrfs for /home" in their Ubuntu "Bleeding-Edge Badger" release. Bron. -

Re: Data Deduplication with the help of an online filesystem check

2009-04-28 Thread Bron Gondwana
On Tue, Apr 28, 2009 at 04:58:15PM -0400, Chris Mason wrote: > > Assuming a 4 kbyte block size that would mean for a 1 Tbyte > > filesystem: > > > > 1Tbyte / 4096 / 8 = 32 Mbyte of memory (this should of course > > be saved to disk from time to time and be restored

Re: More performance results

2009-02-03 Thread Bron Gondwana
On Tue, Feb 03, 2009 at 10:01:36AM -0500, Chris Mason wrote: > [...] In my testing > here, the big difference between ext4 and btrfs isn't writing to files, > it is actually the unlinks. If I take them out of the run, btrfs is > very close to ext4 times. Oh man, what is it with unlinks. Nobody d

Re: single disk reed solomon codes

2008-07-19 Thread Bron Gondwana
On Sat, Jul 19, 2008 at 04:15:43PM -0600, Joe Peterson wrote: > Gerald Nowitzky wrote: > > When a HDD drive reads a sector from disk, it does a > > whole bunch of error recognition and correction measures. Usually there > > are, > > at least, two layers of error correction with different bit spre

Re: Bug Report - crash copying in large file

2008-06-06 Thread Bron Gondwana
On Thu, Jun 05, 2008 at 08:25:09AM -0400, Chris Mason wrote: > On Thu, Jun 05, 2008 at 02:15:16PM +1000, Bron Gondwana wrote: > > Hi, random crash dump if you're interested: > > > > Latest stable btrfs (557:4b7e2b315a32) > > Latest stable progs (234:e6d157c83cfe

Bug Report - crash copying in large file

2008-06-04 Thread Bron Gondwana
Hi, random crash dump if you're interested: Latest stable btrfs (557:4b7e2b315a32) Latest stable progs (234:e6d157c83cfe) Latest Ubuntu Hardy kernel (2.6.24-28-generic). Ubuntu Hardy toolchain (gcc: 4.2.3-2ubuntu7) Filesystem was freshly rebuilt about an hour ago. I rsynced over my Maildir and

Re: [Btrfs-devel] transaction ioctls

2008-04-27 Thread Bron Gondwana
On Thu, 24 Apr 2008 09:06:54 -0400, "Chris Mason" <[EMAIL PROTECTED]> said: > On Wednesday 23 April 2008, Bron Gondwana wrote: > > On Wed, Apr 23, 2008 at 09:23:03AM -0400, Chris Mason wrote: > > > proc A: mkdir dir1 > > > proc A: create dir1/file1 >

Re: [Btrfs-devel] transaction ioctls

2008-04-23 Thread Bron Gondwana
On Wed, Apr 23, 2008 at 09:23:03AM -0400, Chris Mason wrote: > On Wednesday 23 April 2008, Evgeniy Polyakov wrote: > > On Wed, Apr 23, 2008 at 09:07:28AM -0400, Chris Mason > ([EMAIL PROTECTED]) wrote: > > > But, userland expects things not to be undone. Picture two procs > > > operating in a dir