[PATCH v2 RESEND] btrfs-progs: make btrfs qgroups show human readable sizes

2015-01-12 Thread Fan Chengniang
make btrfs qgroups show human readable sizes using --human-readable option, example: qgroupid rfer excl max_rfer max_excl parent child -- - 0/5 299.58MiB299.58MiB400.00MiB0.00B1/

Re: [PATCH v2] btrfs-progs: make btrfs qgroups show human readable sizes

2015-01-12 Thread Duncan
Fan Chengniang posted on Tue, 13 Jan 2015 11:12:55 +0800 as excerpted: > make btrfs qgroups show human readable sizes using --human-readable > option, example: [snip] btrfs-progs uses kernel patching rules, so updated patch versions should include a generally one-line description of what changed

Re: btrfs performance - ssd array

2015-01-12 Thread Wang Shilong
Hello, > Hello, > > we are currently investigating possiblities and performance limits of > the Btrfs filesystem. Now it seems we are getting pretty poor > performance for the writes and I would like to ask, if our results > makes sense and if it is a result of some well known performance > bottl

[PATCH] btrfs-progs: add missing options to qgroup limit

2015-01-12 Thread Fan Chengniang
btrfs qgroup limit has two options -c and -e,. They were forgotten to add to manpage. Signed-off-by: Fan Chengniang --- Documentation/btrfs-qgroup.txt | 9 + 1 file changed, 9 insertions(+) diff --git a/Documentation/btrfs-qgroup.txt b/Documentation/btrfs-qgroup.txt index 8ce1c27..7e370

[PATCH v2] btrfs-progs: make btrfs qgroups show human readable sizes

2015-01-12 Thread Fan Chengniang
make btrfs qgroups show human readable sizes using --human-readable option, example: qgroupid rfer excl max_rfer max_excl parent child -- - 0/5 299.58MiB299.58MiB400.00MiB0.00B1/

[PATCH 0/4] Better btrfsck tree corruption report and automatic csum tree rebuild.

2015-01-12 Thread Qu Wenruo
Although btrfsck can rebuild the csum tree, but has the following problems for end users or sysadmins who is not familiar with btrfs. 1) No brief info on which tree is corrupted. In fact, after extent and chunk tree check, we iterate all the extents and should have a brief view about which tr

[PATCH 2/4] btrfs-progs: Continue repair even some extent reference can't be repaired and report result to user.

2015-01-12 Thread Qu Wenruo
Before this patch, btrfsck will exit repairing if some extent reference can't be repaired. This is somewhat overkilled. This patch will report number of all errors and fixed/recorded one, and continue in repair mode. Signed-off-by: Qu Wenruo --- cmds-check.c | 56 +++

[PATCH 1/4] btrfs-progs: Report corrupted trees after check_chunks_and_extents()

2015-01-12 Thread Qu Wenruo
The function check_chunks_and_extents() will iterate all the extents, so we should have a brief view on which tree is corrupted according to the backref of extents we iterated. This patch will mark root corrupted if we find extents whose backref can't be verified. And after check_chunks_and_extent

[PATCH 3/4] btrfs-progs: Automatically rebuild csum/extent tree if no other tree has corrupted/missing extent.

2015-01-12 Thread Qu Wenruo
If we find other tree has no corrupted/missing extent, we should be safely to rebuild csum/extent tree. This patch will automatically do it using the report_root_corrtuped() result. Signed-off-by: Qu Wenruo --- cmds-check.c | 21 - 1 file changed, 20 insertions(+), 1 deletio

[PATCH 4/4] btrfs-progs: Remove all csum extents for init_csum

2015-01-12 Thread Qu Wenruo
The original csum tree init codes will only rebuild the csum tree, but don't remove the tree block extents in extent tree, and let extent tree repair to repair all the mismatch extents. This is OK if calling --init-csum manually, but it's confusing if csum tree build it executed automatically, and

filesystem unmountable and btrfsck fails to repair after SATA link hiccup

2015-01-12 Thread Piotr Pawłow
Hello, Situation: btrfs on LVM on RAID5, formatted with default options, mounted with noatime,compress=lzo, kernel 3.18.1. While recovering RAID after drive failure, another drive gets a couple of SATA link errors, and it corrupts the FS: http://pp.siedziba.pl/tmp/btrfs-corruption/kern.log.t

Re: Stuck balance, 3.18.0

2015-01-12 Thread Hugo Mills
On Mon, Jan 12, 2015 at 01:36:27PM +, Holger Hoffstätte wrote: > On Mon, 12 Jan 2015 12:27:12 +, Hugo Mills wrote: > > > On Mon, Jan 12, 2015 at 11:21:58AM +, Hugo Mills wrote: > >>I've just added a new disk to my main storage filesystem. Running > >> the obligatory balance to spre

[PATCH 1/1 v2] Btrfs: fix unused members in struct btrfs_root

2015-01-12 Thread Anand Jain
There isn't any real use of following members of struct btrfs_root so delete them. struct kobject root_kobj; struct completion kobj_unregister; Signed-off-by: Anand Jain --- v2: accepts Filipe comment and commit update fs/btrfs/ctree.h | 2 -- fs/btrfs/disk-io.c | 2 -- 2 files changed, 4 d

Re: [PATCH 1/1] Btrfs: fix unused members in struct btrfs_root

2015-01-12 Thread Anand Jain
Thanks Filipe for pointing out. my hands moved too fast, 2 concurrent calls case didn't pop in mind. sorry my mistake. I see other two members (root_kobj and kobj_unregister) are still not used. Anand On 13/01/2015 00:17, Filipe David Manana wrote: On Mon, Jan 12, 2015 at 4:08 PM, Anand Jai

Re: btrfs performance - ssd array

2015-01-12 Thread Austin S Hemmelgarn
On 2015-01-12 10:35, P. Remek wrote: Another thing to consider is that the kernel's default I/O scheduler and the default parameters for that I/O scheduler are almost always suboptimal for SSD's, and this tends to show far more with BTRFS than anything else. Personally >I've found that using

Re: btrfs performance - ssd array

2015-01-12 Thread Austin S Hemmelgarn
On 2015-01-12 10:11, Patrik Lundquist wrote: On 12 January 2015 at 15:54, Austin S Hemmelgarn wrote: Another thing to consider is that the kernel's default I/O scheduler and the default parameters for that I/O scheduler are almost always suboptimal for SSD's, and this tends to show far more

Re: [PATCH 1/1] Btrfs: fix unused members in struct btrfs_root

2015-01-12 Thread Filipe David Manana
On Mon, Jan 12, 2015 at 4:08 PM, Anand Jain wrote: > There isn't any real use of following members of struct btrfs_root > so delete them. > > struct kobject root_kobj; > struct completion kobj_unregister; > struct mutex objectid_mutex; > > Signed-off-by: Anand Jain > --- > fs/btrfs/ctree.h |

[PATCH 1/1] Btrfs: fix unused members in struct btrfs_root

2015-01-12 Thread Anand Jain
There isn't any real use of following members of struct btrfs_root so delete them. struct kobject root_kobj; struct completion kobj_unregister; struct mutex objectid_mutex; Signed-off-by: Anand Jain --- fs/btrfs/ctree.h | 4 fs/btrfs/disk-io.c | 3 --- fs/btrfs/inode-map.c | 2 -- 3

Btrfs on top of LUKS (dm-crypt)

2015-01-12 Thread Patrik Lundquist
Hi, I've been looking at recommended cryptsetup options for Btrfs and I have one question: Marc uses "cryptsetup luksFormat --align-payload=1024" directly on a disk partition and not on e.g. a striped mdraid. Is there a Btrfs reason for that alignment? http://marc.merlins.org/perso/btrfs/post_20

Re: btrfs performance - ssd array

2015-01-12 Thread P. Remek
>Another thing to consider is that the kernel's default I/O scheduler and the >default parameters for that I/O scheduler are almost always suboptimal for >SSD's, and this tends to show far more with BTRFS than anything else. >Personally >I've found that using the CFQ I/O scheduler with the foll

Re: btrfs performance - ssd array

2015-01-12 Thread Patrik Lundquist
On 12 January 2015 at 15:54, Austin S Hemmelgarn wrote: > > Another thing to consider is that the kernel's default I/O scheduler and the > default parameters for that I/O scheduler are almost always suboptimal for > SSD's, and this tends to show far more with BTRFS than anything else. > Person

Re: btrfs performance - ssd array

2015-01-12 Thread Austin S Hemmelgarn
On 2015-01-12 08:51, P. Remek wrote: > Hello, > > we are currently investigating possiblities and performance limits of > the Btrfs filesystem. Now it seems we are getting pretty poor > performance for the writes and I would like to ask, if our results > makes sense and if it is a result of some w

btrfs performance - ssd array

2015-01-12 Thread P. Remek
Hello, we are currently investigating possiblities and performance limits of the Btrfs filesystem. Now it seems we are getting pretty poor performance for the writes and I would like to ask, if our results makes sense and if it is a result of some well known performance bottleneck. Our setup: Se

Re: Stuck balance, 3.18.0

2015-01-12 Thread Holger Hoffstätte
On Mon, 12 Jan 2015 12:27:12 +, Hugo Mills wrote: > On Mon, Jan 12, 2015 at 11:21:58AM +, Hugo Mills wrote: >>I've just added a new disk to my main storage filesystem. Running >> the obligatory balance to spread the data out, it's managed about 14% >> of the job, and then has gone into

Re: Stuck balance, 3.18.0

2015-01-12 Thread Hugo Mills
On Mon, Jan 12, 2015 at 11:21:58AM +, Hugo Mills wrote: >I've just added a new disk to my main storage filesystem. Running > the obligatory balance to spread the data out, it's managed about 14% > of the job, and then has gone into some kind of tight loop. No chunks > have been found or bal

[PATCH v2 5/9] btrfs: remove bio splitting and merge_bvec_fn() calls

2015-01-12 Thread Dongsu Park
From: Kent Overstreet Btrfs has been doing bio splitting from btrfs_map_bio(), by checking device limits as well as calling ->merge_bvec_fn() etc. That is not necessary any more, because generic_make_request() is now able to handle arbitrarily sized bios. So clean up unnecessary code paths. Cc:

Stuck balance, 3.18.0

2015-01-12 Thread Hugo Mills
I've just added a new disk to my main storage filesystem. Running the obligatory balance to spread the data out, it's managed about 14% of the job, and then has gone into some kind of tight loop. No chunks have been found or balanced in the last 2 hours, and one kworker thread is pegged at 100%.