Re: Btrfs RAID1 File System Grew Something Extra

2013-12-18 Thread Hugo Mills
On Tue, Dec 17, 2013 at 11:12:25PM -0500, Garry T. Williams wrote: On 12-18-13 10:46:29 Anand Jain wrote: On 12/18/2013 10:03 AM, Garry T. Williams wrote: I have been using btrfs for my /home partition on my home machine for a few years now. I created the file system RAID1 using two disk

Re: Btrfs RAID1 File System Grew Something Extra

2013-12-18 Thread Duncan
Garry T. Williams posted on Tue, 17 Dec 2013 23:12:25 -0500 as excerpted: On 12-18-13 10:46:29 Anand Jain wrote: On 12/18/2013 10:03 AM, Garry T. Williams wrote: I have been using btrfs for my /home partition on my home machine for a few years now. I created the file system RAID1 using two

[PATCH v2] Btrfs-progs: receive: fix the case that we can not find the subvolume

2013-12-18 Thread Wang Shilong
If we change our default subvolume, btrfs receive will fail to find subvolume. To fix this problem, we have three ideas: 1.make btrfs snapshot ioctl support passing source subvolume's objectid. 2.when we want to using interval subvolume path, we mount it other place that use subvolume 5 as its

Re: btrfs balance on single device

2013-12-18 Thread Leonidas Spyropoulos
I'm using the same subject as it might be relevant, feel free to change it.# I'm trying to do some maintenance to the system running over a btrfs file system on root (/). I started a balance on the '/' partition and it failed with the below information: $ sudo btrfs balance start / [sudo]

[PATCH] Btrfs: improve the performance fluctuating of the fsync

2013-12-18 Thread Miao Xie
In order to improve the performance of fsync, we use the outstanding ordered extents to avoid looking up the checksum from the csum tree. But we didn't filter out the ordered extents whose csum is still being calculated, when we got those ordered extents, we had to wait for the csum calculation.

Re: btrfs balance on single device

2013-12-18 Thread Hugo Mills
On Wed, Dec 18, 2013 at 10:44:43AM +, Leonidas Spyropoulos wrote: I'm using the same subject as it might be relevant, feel free to change it.# I'm trying to do some maintenance to the system running over a btrfs file system on root (/). I started a balance on the '/' partition and it

Re: [PATCH] Btrfs: improve the performance fluctuating of the fsync

2013-12-18 Thread Leonidas Spyropoulos
On Wed, Dec 18, 2013 at 06:52:44PM +0800, Miao Xie wrote: In order to improve the performance of fsync, we use the outstanding ordered extents to avoid looking up the checksum from the csum tree. But we didn't filter out the ordered extents whose csum is still being calculated, when we got

Re: btrfs balance on single device

2013-12-18 Thread Leonidas Spyropoulos
On Wed, Dec 18, 2013 at 11:05:29AM +, Hugo Mills wrote: On Wed, Dec 18, 2013 at 10:44:43AM +, Leonidas Spyropoulos wrote: I'm using the same subject as it might be relevant, feel free to change it.# I'm trying to do some maintenance to the system running over a btrfs file system

no space left, metadata usage almost full?

2013-12-18 Thread Tomasz Chmielewski
I have a btrfs filesystem which has plenty of free space left, yet it's hitting out of space regularly. Here is how it looks like: # btrfs fi df /home Data, RAID1: total=2.51TiB, used=1.58TiB System, RAID1: total=32.00MiB, used=372.00KiB Metadata, RAID1: total=48.00GiB, used=47.23GiB What I

Re: no space left, metadata usage almost full?

2013-12-18 Thread Hugo Mills
On Wed, Dec 18, 2013 at 09:37:28PM +0900, Tomasz Chmielewski wrote: I have a btrfs filesystem which has plenty of free space left, yet it's hitting out of space regularly. Here is how it looks like: # btrfs fi df /home Data, RAID1: total=2.51TiB, used=1.58TiB System, RAID1:

Re: no space left, metadata usage almost full?

2013-12-18 Thread Tomasz Chmielewski
On Wed, 18 Dec 2013 12:46:52 + Hugo Mills h...@carfax.org.uk wrote: # btrfs fi df /home Data, RAID1: total=2.51TiB, used=1.58TiB System, RAID1: total=32.00MiB, used=372.00KiB Metadata, RAID1: total=48.00GiB, used=47.23GiB # btrfs fi balance start -dusage=5 /home Currently, yes,

Re: no space left, metadata usage almost full?

2013-12-18 Thread Hugo Mills
On Wed, Dec 18, 2013 at 11:54:39PM +0900, Tomasz Chmielewski wrote: On Wed, 18 Dec 2013 12:46:52 + Hugo Mills h...@carfax.org.uk wrote: # btrfs fi df /home Data, RAID1: total=2.51TiB, used=1.58TiB System, RAID1: total=32.00MiB, used=372.00KiB Metadata, RAID1: total=48.00GiB,

Btrfs stable updates for 3.12

2013-12-18 Thread David Sterba
Hi, please queue the following patches to 3.12 stable. They fix a few crashes or lockups that were reported by users. The patch stop using vfs_read in send may seem big for stable, but without it the send/receive ioctl hits the global open file limit sooner or later, depending on the ram size.

btrfs on bcache

2013-12-18 Thread eb
I've recently setup a system (Kernel 3.12.5-1-ARCH) which is layered as follows: /dev/sdb3 - cache0 (80 GB Intel SSD) /dev/sdc1 - backing device (2 TB WD HDD) sdb3+sdc1 = /dev/bcache0 On /dev/bcache0, there's a btrfs filesystem with 2 subvolumes, mounted as / and /home. What's been bothering me

Backporting bugfixes

2013-12-18 Thread Pavel Roskin
Hello! I have noticed that there have been important fixes for btrfs in the mainline Linux git repository. However, there is just one btrfs fix in Linux 3.12.5 after 3.12. I think it's important to submit all serious bugfixes to the stable kernels. It would protect users against data

Re: Backporting bugfixes

2013-12-18 Thread Chris Mason
On Wed, 2013-12-18 at 14:06 -0500, Pavel Roskin wrote: Hello! I have noticed that there have been important fixes for btrfs in the mainline Linux git repository. However, there is just one btrfs fix in Linux 3.12.5 after 3.12. I think it's important to submit all serious bugfixes to

Re: Backporting bugfixes

2013-12-18 Thread Pavel Roskin
On Wed, 18 Dec 2013 19:23:08 + Chris Mason c...@fb.com wrote: We do tag some commits for stable, but Dave Sterba actually just sent a request to the stable tree to pull in a few more. That's great news! Thank you for a quick reply! -- Regards, Pavel Roskin -- To unsubscribe from this

Re: Btrfs stable updates for 3.12

2013-12-18 Thread Greg KH
On Wed, Dec 18, 2013 at 04:14:02PM +0100, David Sterba wrote: Hi, please queue the following patches to 3.12 stable. They fix a few crashes or lockups that were reported by users. The patch stop using vfs_read in send may seem big for stable, but without it the send/receive ioctl hits

Re: [PATCH] Btrfs-progs: receive: fix the case that we can not find subvolume

2013-12-18 Thread Michael Welsh Duggan
Wang Shilong wangsl.f...@cn.fujitsu.com writes: On 12/18/2013 12:06 PM, Michael Welsh Duggan wrote: Wang Shilong wangsl.f...@cn.fujitsu.com writes: It seems that you use older kernel version but use the latest btrfs-progs, new btrfs-progs use uuid tree to search but this tree did not exist

Re: Backporting bugfixes

2013-12-18 Thread Duncan
Pavel Roskin posted on Wed, 18 Dec 2013 14:31:53 -0500 as excerpted: On Wed, 18 Dec 2013 19:23:08 + Chris Mason c...@fb.com wrote: We do tag some commits for stable, but Dave Sterba actually just sent a request to the stable tree to pull in a few more. That's great news! Thank you

[PATCH 1/3] Btrfs: introduce lock_ref/unlock_ref

2013-12-18 Thread Josef Bacik
qgroups need to have a consistent view of the references for a particular extent record. Currently they do this through sequence numbers on delayed refs, but this is no longer acceptable. So instead introduce lock_ref/unlock_ref. This will provide the qgroup code with a consistent view of the

Rework qgroup accounting

2013-12-18 Thread Josef Bacik
People have been complaining about autodefrag/defrag killing their box with OOM. This is because the snapshot aware defrag stuff super sucks if you have lots of snapshots, and so that needs to be reworked. The problem is once that is fixed you start to hit horrible lock contention on the delayed

[PATCH 3/3] Btrfs: add sanity tests for new qgroup accounting code

2013-12-18 Thread Josef Bacik
This exercises the various parts of the new qgroup accounting code. We do some basic stuff and do some things with the shared refs to make sure all that code works. I had to add a bunch of infrastructure because I needed to be able to insert items into a fake tree without having to do all the

Re: [PATCH] Btrfs: improve the performance fluctuating of the fsync

2013-12-18 Thread Josef Bacik
On 12/18/2013 05:52 AM, Miao Xie wrote: In order to improve the performance of fsync, we use the outstanding ordered extents to avoid looking up the checksum from the csum tree. But we didn't filter out the ordered extents whose csum is still being calculated, when we got those ordered extents,

Re: [PATCH v4] Btrfs: convert printk to btrfs_ and fix BTRFS prefix

2013-12-18 Thread Josef Bacik
On 12/12/2013 02:57 PM, Frank Holton wrote: Convert all applicable cases of printk and pr_* to the btrfs_* macros. Fix all uses of the BTRFS prefix. Signed-off-by: Frank Holton fhol...@gmail.com There are tailing whitespaces everywhere. Please run this through checkpatch.pl so you can fix

Re: Rework qgroup accounting

2013-12-18 Thread Liu Bo
On Wed, Dec 18, 2013 at 04:07:26PM -0500, Josef Bacik wrote: People have been complaining about autodefrag/defrag killing their box with OOM. This is because the snapshot aware defrag stuff super sucks if you have lots of snapshots, and so that needs to be reworked. The problem is once

[PATCH] btrfs: fix the warning in prepare_pages

2013-12-18 Thread Anand Jain
would fix the below compile warning fs/btrfs/file.c: In function ‘prepare_pages’: fs/btrfs/file.c:1247: warning: ‘err’ may be used uninitialized in this function Signed-off-by: Anand Jain anand.j...@oracle.com --- fs/btrfs/file.c |2 +- 1 files changed, 1 insertions(+), 1 deletions(-) diff

[PATCH v3] btrfs: add framework to read fs info from btrfs-control

2013-12-18 Thread Anand Jain
This adds ioctl BTRFS_IOC_GET_FSIDS which reads the fs info through the btrfs-control, needed to optimize heavily used btrfs-progs function check_mounted() plus few other minor uses. Signed-off-by: Anand Jain anand.j...@oracle.com --- v3: rebase and update commit v2: accepts Zach suggested and

[PATCH] btrfs: ioctls would need unique id

2013-12-18 Thread Anand Jain
BTRFS_IOC_SET_FEATURES and BTRFS_IOC_GET_SUPPORTED_FEATURES conflicts with BTRFS_IOC_GET_FEATURES Signed-off-by: Anand Jain anand.j...@oracle.com --- include/uapi/linux/btrfs.h |4 ++-- 1 files changed, 2 insertions(+), 2 deletions(-) diff --git a/include/uapi/linux/btrfs.h

[PATCH] btrfs-progs: sync-up with newly introduced ioctl number

2013-12-18 Thread Anand Jain
for now the manual sync up of new ioctls introduced in the btrfs kernel. For which there wasn't any btrfs-progs patch. however we might have better idea for the long run. Signed-off-by: Anand Jain anand.j...@oracle.com --- ioctl.h |6 ++ 1 files changed, 6 insertions(+), 0 deletions(-)

Re: [PATCH v2] Btrfs: fix tree mod logging

2013-12-18 Thread Ahmet Inan
Thanks a lot Filipe! Have been testing this patch now for 5 days and it fixed this annoying Problem since 3.11.0 on 3x NFS Servers here. This is also a candidate that should be back ported, as it fixes crashes. Just for Information for others here: Your previous patch, Btrfs: return immediately