Re: Poor performance unlinking hard-linked files (repost)

2010-11-30 Thread Chris Mason
Excerpts from Bron Gondwana's message of 2010-11-30 04:35:10 -0500: On Sat, Nov 20, 2010 at 08:58:10AM +1100, Bron Gondwana wrote: On Fri, Nov 19, 2010 at 09:10:08AM -0500, Chris Mason wrote: Excerpts from Bron Gondwana's message of 2010-11-18 16:46:31 -0500: On Thu, Nov 18, 2010 at

Re: Poor performance unlinking hard-linked files (repost)

2010-11-30 Thread Bron Gondwana
On Tue, Nov 30, 2010 at 07:49:26AM -0500, Chris Mason wrote: Excerpts from Bron Gondwana's message of 2010-11-30 04:35:10 -0500: Do you have any suggestsions for what I could try? You mentioned READ_SYNC above. We now have one working partition on this machine, but it took longer to

Re: Poor performance unlinking hard-linked files (repost)

2010-11-19 Thread Bron Gondwana
On Fri, Nov 19, 2010 at 09:10:08AM -0500, Chris Mason wrote: Excerpts from Bron Gondwana's message of 2010-11-18 16:46:31 -0500: On Thu, Nov 18, 2010 at 10:30:47AM -0500, Chris Mason wrote: http://pastebin.com/Tg7agv42 Ok, we're mixing unlinks and fsyncs. If it fsyncing directories

Re: Poor performance unlinking hard-linked files (repost)

2010-11-18 Thread Chris Mason
Excerpts from Bron Gondwana's message of 2010-11-16 23:11:48 -0500: On Tue, Nov 16, 2010 at 08:38:13AM -0500, Chris Mason wrote: Excerpts from Bron Gondwana's message of 2010-11-16 07:54:45 -0500: Just posting this again more neatly formatted and just the 'meat': a) program creates

Re: Poor performance unlinking hard-linked files (repost)

2010-11-17 Thread Bron Gondwana
On Wed, Nov 17, 2010 at 03:11:48PM +1100, Bron Gondwana wrote: Could you sysrq-w while the performance is bad? That would narrow it down. Here's one: http://pastebin.com/Tg7agv42 And here's another one, inline this time. The iostat for 10 seconds just before said: (iostat -x 10 10)

Poor performance unlinking hard-linked files (repost)

2010-11-16 Thread Bron Gondwana
Just posting this again more neatly formatted and just the 'meat': a) program creates piles of small temporary files, hard links them out to different directories, unlinks the originals. b) filesystem size: ~ 300Gb (backed by hardware RAID5) c) as the filesystem grows (currently about 30%

Re: Poor performance unlinking hard-linked files (repost)

2010-11-16 Thread Chris Mason
Excerpts from Bron Gondwana's message of 2010-11-16 07:54:45 -0500: Just posting this again more neatly formatted and just the 'meat': a) program creates piles of small temporary files, hard links them out to different directories, unlinks the originals. b) filesystem size: ~ 300Gb

Re: Poor performance unlinking hard-linked files (repost)

2010-11-16 Thread Bron Gondwana
On Tue, Nov 16, 2010 at 08:38:13AM -0500, Chris Mason wrote: Excerpts from Bron Gondwana's message of 2010-11-16 07:54:45 -0500: Just posting this again more neatly formatted and just the 'meat': a) program creates piles of small temporary files, hard links them out to different