Re: [RFC] Experimental btrfs encryption

2016-03-02 Thread Anand Jain
Thanks! for commenting Qu. As you are working near these codes appreciate any code review comments. +1 here, but in fact, it's easy to deal with. As long as not implement encryption as a compression method. Just like inband dedup, we use the following method to support dedup and compression

Re: [RFC] Experimental btrfs encryption

2016-03-02 Thread Anand Jain
Hi Qu, Not only move, but also reflink/inband dedup. oh yes thanks. I shall add those. Yes, but in fact, you can use another method, just like in-band de-dup, by adding new hook into async_cow_start() and async_cow_end(), allowing compression and encryption can be done at the same time. (W

BTRFS Raid 6 corruption - please help with restore

2016-03-02 Thread Stuart Gittings
Hi - I have some corruption on a 12 drive Raid 6 volume. Here's the basics - if someone could help with restore it would save me a ton of time (and some data loss - I have critical data backed up, but not all). stuart@debian:~$ uname -a Linux debian 4.3.0-0.bpo.1-amd64 #1 SMP Debian 4.3.3-7~bpo8+

Still in 4.4.0: livelock in recovery (free_reloc_roots)

2016-03-02 Thread Lukas Pirl
On 11/20/2015 10:04 AM, Lukas Pirl wrote as excerpted: > I am (still) trying to recover a RAID1 that can only be mounted > recovery,degraded,ro. > > I experienced an issue that might be interesting for you: I tried to > mount the file system rw,recovery and the kernel ended up burning one > core (

Re: raid5

2016-03-02 Thread Austin S. Hemmelgarn
On 2016-03-01 16:44, Duncan wrote: John Smith posted on Tue, 01 Mar 2016 15:24:04 +0100 as excerpted: what is the status of btrfs raid5 in kernel 4.4? Thank you That is a very good question. =:^) The answer, to the best I can give it, is, btrfs raid56 mode has no known outstanding bugs spec

Re: btrfs-progs: initial scan-build results

2016-03-02 Thread David Sterba
On Tue, Mar 01, 2016 at 05:39:29PM +0100, Holger Hoffstätte wrote: > On 03/01/16 16:45, Holger Hoffstätte wrote: > > On 03/01/16 14:41, Alexander Fougner wrote: > >> All zero-sized allocations are false positives, except the > > Right, I've now also reviewed them all and they are all guarded > by

[PATCH] Btrfs: fix loading of orphan roots leading to BUG_ON

2016-03-02 Thread fdmanana
From: Filipe Manana When looking for orphan roots during mount we can end up hitting a BUG_ON() (at root-item.c:btrfs_find_orphan_roots()) if a log tree is replayed and qgroups are enabled. This is because after a log tree is replayed, a transaction commit is made, which triggers qgroup extent ac

[PATCH] fstests: btrfs, test log replay with qgroups enabled and orphan roots

2016-03-02 Thread fdmanana
From: Filipe Manana Test that replaying a log tree when qgroups are enabled and orphan roots (deleted snapshots) exist, the replay process does not crash. This is motivated by a bug found in btrfs, introduced in the linux kernel 4.4 release, and is fixed by the following patch: Btrfs: fix loa

[PATCH] btrfs-convert: document -O|--features flag

2016-03-02 Thread Vytas Dauksa
Copy-pasted description found at mkfs.btrfs. I did not bother with feature list as it seemed to be incomplete. --- Documentation/btrfs-convert.asciidoc | 7 +++ 1 file changed, 7 insertions(+) diff --git a/Documentation/btrfs-convert.asciidoc b/Documentation/btrfs-convert.asciidoc index ca34

Re: BTRFS Raid 6 corruption - please help with restore

2016-03-02 Thread Chris Murphy
On Wed, Mar 2, 2016 at 3:47 AM, Stuart Gittings wrote: > Hi - I have some corruption on a 12 drive Raid 6 volume. Here's the > basics - if someone could help with restore it would save me a ton of > time (and some data loss - I have critical data backed up, but not > all). > > stuart@debian:~$ un

Re: BTRFS Raid 6 corruption - please help with restore

2016-03-02 Thread Chris Murphy
On Wed, Mar 2, 2016 at 11:42 AM, Stuart Gittings wrote: > All devices are present. Btrfs if show is listed below and shows they are > all there. I'm afraid btrfs dev scan does not help What do you get for 'btrfs check' (do not use --repair yet) -- Chris Murphy -- To unsubscribe from thi

duplicate automounts with btrfs RAID1

2016-03-02 Thread Leigh Orf
Hello, Not entirely sure this is a btrfs issue, but here is my problem. I've had this issue with recent Fedora and CentOS distros. I created a btrfs RAID 1 pair with two identical USB external drives, following the instructions found online: mkfs.btrfs -m raid1 -d raid1 /dev/sdc1 /dev/sdd1 Then

Re: duplicate automounts with btrfs RAID1

2016-03-02 Thread Pavol Cupka
is anything in dmesg that would point to diskscontrollers being reset? or something like that? pavol On Wed, Mar 2, 2016 at 9:34 PM, Leigh Orf wrote: > Hello, > > Not entirely sure this is a btrfs issue, but here is my problem. I've > had this issue with recent Fedora and CentOS distros. > > I

Re: duplicate automounts with btrfs RAID1

2016-03-02 Thread Leigh Orf
On Wed, Mar 2, 2016 at 3:34 PM, Pavol Cupka wrote: > is anything in dmesg that would point to diskscontrollers being reset? > > or something like that? > > pavol Pavol, Hmm, yes, there are some weird things going on. I am attaching what I see as the relevant bits from /var/log/messages (command:

Re: "WARNING: device 0 not present" during scrub?

2016-03-02 Thread Nils Steinger
On 01.02.2016 11:23, Patrik Lundquist wrote: > apt-get install -t jessie-backports linux-image-4.3.0-0.bpo.1-amd64 > > Or something like that for the image name. Unfortunately there's no > stable backport of btrfs-tools (as they call btrfs-progs). There is now: 4.4-1~bpo8+1 Upgrading from btrfs-

Re: duplicate automounts with btrfs RAID1

2016-03-02 Thread Pavol Cupka
and disk/ata/usb resets? On Wed, Mar 2, 2016 at 10:56 PM, Leigh Orf wrote: > On Wed, Mar 2, 2016 at 3:34 PM, Pavol Cupka wrote: >> is anything in dmesg that would point to diskscontrollers being reset? >> >> or something like that? >> >> pavol > > Pavol, > > Hmm, yes, there are some weird things

Re: Again, no space left on device while rebalancing and recipe doesnt work

2016-03-02 Thread Dāvis Mosāns
2016-02-27 23:14 GMT+02:00 Marc Haber : > Hi, > > I have again the issue of no space left on device while rebalancing > (with btrfs-tools 4.4.1 on kernel 4.4.2 on Debian unstable): > I've same issue, 4.4.3 kernel on Arch Linux $ sudo btrfs fi show /mnt/fs/ Label: 'fs' uuid: a3c66d25-2c25-40e5-a8

Re: [RFC] Experimental btrfs encryption

2016-03-02 Thread Qu Wenruo
Anand Jain wrote on 2016/03/02 16:50 +0800: Thanks! for commenting Qu. As you are working near these codes appreciate any code review comments. +1 here, but in fact, it's easy to deal with. As long as not implement encryption as a compression method. Just like inband dedup, we use the

Re: duplicate automounts with btrfs RAID1

2016-03-02 Thread Anand Jain
First, If /dev/sdc1 is getting disappeared and reappearing you may have this problem, securing the connection for /dev/sdc1 will help. But, Should automount be more intelligent to identify FSID thats already mounted ? In btrfs RAIDs, Both /dev/sdc1 /dev/sdd1 contains same FSID. With btrfs its n

incomplete conversion to RAID1?

2016-03-02 Thread Nicholas D Steeves
Hi, I recently moved my main system to btrfs and had to shuffle everything around in tricky ways while migrating from LVM while maintaining at least two copies + backup of everything. I'm using linux-4.4.3 with btrfs-progs-4.4.1. The end result, after adding sdc and then converting both metadata

Re: [RFC] Experimental btrfs encryption

2016-03-02 Thread Qu Wenruo
Anand Jain wrote on 2016/03/02 17:09 +0800: Hi Qu, Not only move, but also reflink/inband dedup. oh yes thanks. I shall add those. Yes, but in fact, you can use another method, just like in-band de-dup, by adding new hook into async_cow_start() and async_cow_end(), allowing compression

Re: [RFC] Experimental btrfs encryption

2016-03-02 Thread Anand Jain
. (I received couple of private emails on this, so looks like I confused you and I'm writing again to clear the air on this). - Uses btrfs compression framework, so compression and then encryption is not possible. However yet evaluate if there are encryption algorithm which can compres

Re: Again, no space left on device while rebalancing and recipe doesnt work

2016-03-02 Thread Qu Wenruo
Thanks for the output. At least for mprofile enospc error, the problem itself is very straightforward, just unable to alloc tree block. I'll check the codes to see if we can improve it, by finding out why we can't alloc a new chunk to resolve the problem. But I'm still a little concerned ab

Re: Again, no space left on device while rebalancing and recipe doesnt work

2016-03-02 Thread Qu Wenruo
Dāvis Mosāns wrote on 2016/03/03 02:28 +0200: 2016-02-27 23:14 GMT+02:00 Marc Haber : Hi, I have again the issue of no space left on device while rebalancing (with btrfs-tools 4.4.1 on kernel 4.4.2 on Debian unstable): I've same issue, 4.4.3 kernel on Arch Linux $ sudo btrfs fi show /mnt/

Re: raid5

2016-03-02 Thread Duncan
Austin S. Hemmelgarn posted on Wed, 02 Mar 2016 08:43:17 -0500 as excerpted: > On 2016-03-01 16:44, Duncan wrote: >> John Smith posted on Tue, 01 Mar 2016 15:24:04 +0100 as excerpted: >> >>> what is the status of btrfs raid5 in kernel 4.4? Thank you >> >> That is a very good question. =:^) >> >>

Re: [PATCH] Btrfs: fix loading of orphan roots leading to BUG_ON

2016-03-02 Thread Duncan
fdmanana posted on Wed, 02 Mar 2016 15:49:38 + as excerpted: > When looking for orphan roots during mount we can end up hitting a > BUG_ON() (at root-item.c:btrfs_find_orphan_roots()) if a log tree is > replayed and qgroups are enabled. This should hit 4.6, right? Will it hit 4.5 before rele

Re: Again, no space left on device while rebalancing and recipe doesnt work

2016-03-02 Thread Duncan
Dāvis Mosāns posted on Thu, 03 Mar 2016 02:28:36 +0200 as excerpted: > 2016-02-27 23:14 GMT+02:00 Marc Haber : >> Hi, >> >> I have again the issue of no space left on device while rebalancing >> (with btrfs-tools 4.4.1 on kernel 4.4.2 on Debian unstable): >> >> > I've same issue, 4.4.3 kernel on A

Re: incomplete conversion to RAID1?

2016-03-02 Thread Duncan
Nicholas D Steeves posted on Wed, 02 Mar 2016 20:25:46 -0500 as excerpted: > btrfs fi show > Label: none uuid: 2757c0b7-daf1-41a5-860b-9e4bc36417d3 > Total devices 2 FS bytes used 882.28GiB > devid1 size 926.66GiB used 886.03GiB path /dev/sdb1 > devid2 size 926.6

Re: [PATCH] Btrfs: fix loading of orphan roots leading to BUG_ON

2016-03-02 Thread Qu Wenruo
Duncan wrote on 2016/03/03 04:31 +: fdmanana posted on Wed, 02 Mar 2016 15:49:38 + as excerpted: When looking for orphan roots during mount we can end up hitting a BUG_ON() (at root-item.c:btrfs_find_orphan_roots()) if a log tree is replayed and qgroups are enabled. This should hit

Re: [PATCH] Btrfs: fix loading of orphan roots leading to BUG_ON

2016-03-02 Thread Qu Wenruo
wrote on 2016/03/02 15:49 +: From: Filipe Manana When looking for orphan roots during mount we can end up hitting a BUG_ON() (at root-item.c:btrfs_find_orphan_roots()) if a log tree is replayed and qgroups are enabled. This is because after a log tree is replayed, a transaction commit is

Re: duplicate automounts with btrfs RAID1

2016-03-02 Thread Duncan
Leigh Orf posted on Wed, 02 Mar 2016 14:34:41 -0600 as excerpted: > Here is info about my setup (up to date CentOS 7.2): > > % cat /etc/system-release > CentOS Linux release 7.2.1511 (Core) > % uname -a > Linux xxx.xxx.xxx.edu 3.10.0-123.20.1.el7.x86_64 #1 SMP > Thu Jan 29 18:05:33 UTC 2015 x86_

Re: [PATCH] Btrfs: fix loading of orphan roots leading to BUG_ON

2016-03-02 Thread Duncan
Qu Wenruo posted on Thu, 03 Mar 2016 14:26:45 +0800 as excerpted: > Never heard the 2 release cycles principle, but seems to be not flex > enough. > From this point of view, every time Filipe(just an example, as he finds > the most of bugs and corner case), some part or even the whole btrfs is >