Re: Filesystem unable to recover from ENOSPC

2014-04-11 Thread Chip Turner
Thank you for the extremely detailed and helpful reply. I now understand what was happening. To me, when I read total= I guess I thought that was capacity rather than allocated (but now holey) chunks. I agree that perhaps adjusting the phrasing of the output of df and show would be helpful in

Re: [PATCH 2/2] btrfs-progs: Add explain on btrfs-zero-log.

2014-04-11 Thread Marc MERLIN
On Fri, Apr 11, 2014 at 10:43:53AM +0800, Qu Wenruo wrote: Add more explain on btrfs-zero-log about when to use it. Cc: Marc MERLIN m...@merlins.org Signed-off-by: Qu Wenruo quwen...@cn.fujitsu.com Reviewed-by: Marc MERLIN m...@merlins.org Looks good, thank you. Marc ---

Re: [PATCH 1/2] btrfs-progs: Add device management related paragraph.

2014-04-11 Thread Qu Wenruo
Original Message Subject: Re: [PATCH 1/2] btrfs-progs: Add device management related paragraph. From: Marc MERLIN m...@merlins.org To: Qu Wenruo quwen...@cn.fujitsu.com Date: 2014年04月11日 14:10 On Fri, Apr 11, 2014 at 10:43:52AM +0800, Qu Wenruo wrote: Add device management

Re: [PATCH 1/2] btrfs-progs: Add device management related paragraph.

2014-04-11 Thread Liu Bo
On Fri, Apr 11, 2014 at 10:43:52AM +0800, Qu Wenruo wrote: Add device management related paragraph to better explain btrfs device management. Cc: Marc MERLIN m...@merlins.org Signed-off-by: Qu Wenruo quwen...@cn.fujitsu.com --- Documentation/btrfs-balance.txt | 3 +++

mount options ignored / unclear

2014-04-11 Thread Swâmi Petaramesh
Hello, (Still in my quest for BTRFS performance) It is extremely unclear which BTRFS mount options are filesystem wide and will apply to each and every mountpoint in the BTRFS filesystem, and which options can be set per subvolume or per mountpoint. As far as I can tell, there is no reliable

Re: [RFC PATCH v10 00/16] Online(inband) data deduplication

2014-04-11 Thread Martin Steigerwald
Hi Liu, Am Donnerstag, 10. April 2014, 23:55:21 schrieb Liu Bo: Hi, Just FYI, these patches are also available on the following site, kernel: https://github.com/liubogithub/btrfs-work.git dedup-on-3.14-linux progs: https://github.com/liubogithub/btrfs-progs.git dedup I bet its good

Re: Filesystem unable to recover from ENOSPC

2014-04-11 Thread Liu Bo
On Thu, Apr 10, 2014 at 11:10:33PM -0700, Chip Turner wrote: Thank you for the extremely detailed and helpful reply. I now understand what was happening. To me, when I read total= I guess I thought that was capacity rather than allocated (but now holey) chunks. I agree that perhaps

How to make BTRFS crawl

2014-04-11 Thread Swâmi Petaramesh
Hi, I was asked about situations use cases that would cause BTRFS to slow down to a crawl. And it's exactly what happened to me yesterday when I was trying, on the contrary, to speed it up. So here's the recipe for getting a slow to the point it is unusable BTRFS. 1/ Perform a clean, fresh

Re: [RFC PATCH v10 00/16] Online(inband) data deduplication

2014-04-11 Thread Liu Bo
On Fri, Apr 11, 2014 at 11:28:48AM +0200, Martin Steigerwald wrote: Hi Liu, Am Donnerstag, 10. April 2014, 23:55:21 schrieb Liu Bo: Hi, Just FYI, these patches are also available on the following site, kernel: https://github.com/liubogithub/btrfs-work.git dedup-on-3.14-linux

[PATCH] Btrfs: fix compile warnings on on avr32 platform

2014-04-11 Thread Wang Shilong
fs/btrfs/scrub.c: In function 'get_raid56_logic_offset': fs/btrfs/scrub.c:2269: warning: comparison of distinct pointer types lacks a cast fs/btrfs/scrub.c:2269: warning: right shift count = width of type fs/btrfs/scrub.c:2269: warning: passing argument 1 of '__div64_32' from incompatible

Re: Copying a disk containing a btrfs filesystem

2014-04-11 Thread Brendan Hide
Hi, Michael Btrfs send/receive can transfer incremental snapshots as well - you're looking for the -p or parent parameter. On the other hand, it might not be the right tool for the job. If you're 100% happy with your old disk's *content*/layout/etc (just not happy with the disk's

What does scrub do?

2014-04-11 Thread Alex
Hi all, Debian testing/Jessie-to-be; except kernels/btrfs-tools are from unstable so usually couple of weeks later than you/Linus publish. Linux XX 3.13-1-amd64 #1 SMP Debian 3.13.7-1 (2014-03-25) x86_64 Btrfs-tools v3.12 Debian standard (not particularly messed with looks like) I've never had

Re: How to debug very very slow file delete? (btrfs on md-raid5)

2014-04-11 Thread Chris Samuel
On Tue, 25 Mar 2014 09:41:42 AM Marc MERLIN wrote: 4 hours to stat 700K files. That's bad... Even 11mn to restat them just to count them looks bad too. One way to get an idea of where that's happening is to run the command with strace -c to build up a table of times spent in each system call,

using same btrfs from diferent distros/kernels

2014-04-11 Thread Julio E. Gonzalez P.
I have a multiboot PC with Centos 6.5, Fedora 20, and Ubuntu 13.10. Also there is a btrfs partition I want to mount, read and write from the 3 diferent distros. Is this safe ? Is the btrfs versions from this 3 distros compatible between them ? This is for testing and learning only. Thanks.

Re: How to make BTRFS crawl

2014-04-11 Thread Hugo Mills
On Fri, Apr 11, 2014 at 07:11:52AM -0700, George Mitchell wrote: Well, Akonadi brought my system to its knees long before I converted to btrfs, so somehow I am not surprised. I have kept akonadi disabled ever since.for everything except a portion of Thunderbird and that ONLY with sql-lite.

[GIT PULL] Btrfs part two

2014-04-11 Thread Chris Mason
Hi Linus, Please grab my for-linus branch: git://git.kernel.org/pub/scm/linux/kernel/git/mason/linux-btrfs.git for-linus The most important changes here are from Josef, fixing a btrfs regression in 3.14 that can cause corruptions in the extent allocation tree when snapshots are in use. Josef

Re: How to debug very very slow file delete? (btrfs on md-raid5)

2014-04-11 Thread Marc MERLIN
On Sat, Apr 12, 2014 at 12:15:14AM +1000, Chris Samuel wrote: On Tue, 25 Mar 2014 09:41:42 AM Marc MERLIN wrote: 4 hours to stat 700K files. That's bad... Even 11mn to restat them just to count them looks bad too. One way to get an idea of where that's happening is to run the command

Re: [PATCH 1/2] btrfs-progs: Add device management related paragraph.

2014-04-11 Thread David Sterba
On Fri, Apr 11, 2014 at 05:16:22PM +0800, Liu Bo wrote: +DEVICE MANAGEMENT +- +Btrfs filesystem is capable to manage multiple devices. + +Btrfs filesystem use different profiles to manage different RAID level, and +use balance to rebuild chunks, also devices can be

Re: [PATCH 1/2] btrfs-progs: Add device management related paragraph.

2014-04-11 Thread David Sterba
On Thu, Apr 10, 2014 at 11:10:48PM -0700, Marc MERLIN wrote: --- a/Documentation/btrfs-replace.txt +++ b/Documentation/btrfs-replace.txt @@ -13,6 +13,9 @@ DESCRIPTION --- 'btrfs replace' is used to replace btrfs managed devices with other device. I would add a quick line

Re: [PATCH 1/2] btrfs-progs: Add device management related paragraph.

2014-04-11 Thread Marc MERLIN
On Fri, Apr 11, 2014 at 07:36:28PM +0200, David Sterba wrote: On Thu, Apr 10, 2014 at 11:10:48PM -0700, Marc MERLIN wrote: --- a/Documentation/btrfs-replace.txt +++ b/Documentation/btrfs-replace.txt @@ -13,6 +13,9 @@ DESCRIPTION --- 'btrfs replace' is used to replace

Re: [PATCH] Btrfs-progs: update btrfs_file_extent_inline_len to match kernel version

2014-04-11 Thread David Sterba
On Tue, Apr 08, 2014 at 06:25:43PM +0100, Filipe David Borba Manana wrote: The following kernel commit changed the definition of the inline function btrfs_file_extent_inline_len(): commit 514ac8ad8793a097c0c9d89202c642479d6dfa34 Author: Chris Mason c...@fb.com Date: Fri Jan 3

Re: [PATCH] Btrfs-progs: update btrfs_file_extent_inline_len to match kernel version

2014-04-11 Thread Filipe David Manana
On Fri, Apr 11, 2014 at 6:49 PM, David Sterba dste...@suse.cz wrote: On Tue, Apr 08, 2014 at 06:25:43PM +0100, Filipe David Borba Manana wrote: The following kernel commit changed the definition of the inline function btrfs_file_extent_inline_len(): commit

Re: using same btrfs from diferent distros/kernels

2014-04-11 Thread Duncan
Julio E. Gonzalez P. posted on Fri, 11 Apr 2014 10:19:45 -0400 as excerpted: I have a multiboot PC with Centos 6.5, Fedora 20, and Ubuntu 13.10. Also there is a btrfs partition I want to mount, read and write from the 3 diferent distros. Is this safe ? Is the btrfs versions from this 3

Re: [PATCH] Btrfs-progs: update btrfs_file_extent_inline_len to match kernel version

2014-04-11 Thread David Sterba
On Fri, Apr 11, 2014 at 06:51:58PM +0100, Filipe David Manana wrote: Thanks David. Can you add it please? I was using an older version of the integration branch. Yes, fixed. The patch flux in the integration can cause minor issues and I try to fix them myself if possible, sometimes with a note

Re: [RFC PATCH v10 00/16] Online(inband) data deduplication

2014-04-11 Thread Michael
Hi Liu, Thanks for your work. Each test copy 2gb file from sdf (btrfs) to sde (btrfs with dedup 4k blocksize). Before every test i recreate filesystem. On second write all goods. Test 1 Nodesize = leafsize = 4k Write overhead ~ x1.5 Test 2 Nodesize = leafsize = 16k Write overhead ~ x19

Re: How to debug very very slow file delete? (btrfs on md-raid5)

2014-04-11 Thread Duncan
Marc MERLIN posted on Fri, 11 Apr 2014 10:23:46 -0700 as excerpted: Is anyone else using btrfs on top of dmcrypt and software raid 5? There may be others, but I haven't seen them active on-list. For active list users, I think you're leading the pack in that area. =:^/ -- Duncan - List

Re: What does scrub do?

2014-04-11 Thread Duncan
Alex posted on Fri, 11 Apr 2014 11:23:31 + as excerpted: I've never had scrub report anything other than 0 (zero) errors. Ever. Yet I've had more than one ( ;-) ) problem which required btrfs-zero-log and/or btrfs --repair. This are usually my fault - fixed it 'til it broke. root@XX ~

Re: How to debug very very slow file delete? (btrfs on md-raid5)

2014-04-11 Thread Roman Mamedov
On Fri, 11 Apr 2014 10:23:46 -0700 Marc MERLIN m...@merlins.org wrote: Is anyone else using btrfs on top of dmcrypt and software raid 5? I use Btrfs accessed via NBD over a LAN, physically stored on mdadm RAID5, a setup which is similar to yours in that the block device used for Btrfs has a

Re: [GIT PULL] Btrfs part two

2014-04-11 Thread Chris Samuel
Hi Chris, On Fri, 11 Apr 2014 12:50:26 PM Chris Mason wrote: The most important changes here are from Josef, fixing a btrfs regression in 3.14 that can cause corruptions in the extent allocation tree when snapshots are in use. Will these regression fixes go to stable too? cheers, Chris --

Re: mount options ignored / unclear

2014-04-11 Thread Duncan
Swâmi Petaramesh posted on Fri, 11 Apr 2014 11:21:55 +0200 as excerpted: It is extremely unclear which BTRFS mount options are filesystem wide and will apply to each and every mountpoint in the BTRFS filesystem, and which options can be set per subvolume or per mountpoint. As far as I can