Re: Extremely slow metadata performance

2013-12-06 Thread John Goerzen
On 12/05/2013 05:32 PM, Russell Coker wrote: On Thu, 5 Dec 2013 11:52:04 John Goerzen wrote: > I have observed extremely slow metadata performance with btrfs. This may > be a bit of a nightmare scenario; it involves untarring a backup of > 1.6TB of backuppc data, which contains mi

Re: Extremely slow metadata performance

2013-12-05 Thread John Goerzen
On 12/05/2013 05:32 PM, Russell Coker wrote: On Thu, 5 Dec 2013 11:52:04 John Goerzen wrote: > I have observed extremely slow metadata performance with btrfs. This may > be a bit of a nightmare scenario; it involves untarring a backup of > 1.6TB of backuppc data, which contains mi

Extremely slow metadata performance

2013-12-05 Thread John Goerzen
Hello, I have observed extremely slow metadata performance with btrfs. This may be a bit of a nightmare scenario; it involves untarring a backup of 1.6TB of backuppc data, which contains millions of hardlinks and much data, onto USB 2.0 disks. I have run disk monitoring tools such as dstat whi

Re: umount waiting for 12 hours and still running

2013-11-05 Thread John Goerzen
On 11/05/2013 12:46 PM, Tomasz Chmielewski wrote: More than 12 hours ago, I tried to umount a btrfs filesystem. Something involving btrfs-cleaner and btrfs-transacti is still running, but I don't know what. Does "iostat -x 1" or "iostat -k 1" show any disk activity? Yes. For instance, from

Re: umount waiting for 12 hours and still running

2013-11-05 Thread John Goerzen
Duncan <1i5t5.duncan cox.net> writes: > > John Goerzen posted on Tue, 05 Nov 2013 07:42:02 -0600 as excerpted: > > > The filesystem in question involves two 2TB USB hard drives. It is 49% > > full. Data is RAID0, metadata is RAID1. The files stored on it are for

umount waiting for 12 hours and still running

2013-11-05 Thread John Goerzen
Hello, More than 12 hours ago, I tried to umount a btrfs filesystem. Something involving btrfs-cleaner and btrfs-transacti is still running, but I don't know what. I have noticed excessively long umount times before, and it is a significant concern for me. A bit of background: The filesystem i

Excessive RAM usage in btrfs_inode & btrfs_delayed_node

2013-10-25 Thread John Goerzen
Hello, This is an x86_64 box running 3.10. It is presently running restore from the e2fs dump/restore, restoring a dump made on an ext4 system onto a btrfs filesystem. The btrfs filesystem is the only btrfs filesystem mounted on the machine, and it is mounted with only the noatime mount option.

rm with quotas can cause panic (was Re: Lots of trouble hanging when rm files with many extents)

2013-10-25 Thread John Goerzen
John Goerzen complete.org> writes: > > On 10/20/2013 09:51 AM, Tomasz Chmielewski wrote: > > I'll do some more tests with lots of extents to see if it's > > reproducible here as well. > > > > > Interestingly, I've generally had qgroups enable

Re: Lots of trouble hanging when rm files with many extents

2013-10-21 Thread John Goerzen
On 10/20/2013 11:36 PM, Tomasz Chmielewski wrote: I'll do some more tests with lots of extents to see if it's reproducible here as well. Interestingly, I've generally had qgroups enabled here as well, possibly on all of these systems. Could that be the culprit? Possibly. Is there a reliable w

Re: Lots of trouble hanging when rm files with many extents

2013-10-20 Thread John Goerzen
On 10/20/2013 09:51 AM, Tomasz Chmielewski wrote: but I am not sure if that was the right thing to do. This is producing OOM issues and leading to system crashes (including eventual panics) with such alarming frequency that I wonder if perhaps there is something different about my setup than oth

Lots of trouble hanging when rm files with many extents

2013-10-19 Thread John Goerzen
Hello folks, I reported a bug here: https://bugzilla.kernel.org/show_bug.cgi?id=63071 but I am not sure if that was the right thing to do. This is producing OOM issues and leading to system crashes (including eventual panics) with such alarming frequency that I wonder if perhaps there is someth

Conversion from ext4 fails

2013-10-14 Thread John Goerzen
Hello, I have been seeing this behavior (on the unmounted filesystem, of course!): date && time btrfs-convert /dev/mapper/bakfs Sat Oct 12 23:13:21 CDT 2013 creating btrfs metadata. error during copy_inodes -1 conversion aborted. real43m1.076s user15m25.256s sys 0m21.508s This is 1