Re: [PATCH 1/5] Btrfs: incremental send, avoid circular waiting and descendant overwrite ancestor need to update path

2015-06-04 Thread Robbie Ko
Hi Filipe, There is another case for 2nd scenario where is_ancestor() can't be used. Parent snapshot: | a/ (ino 261) | c (ino 267) | d/ (ino 259) | ance/ (ino 266) | waiting_dir/ (ino 262) | pre/ (ino 264) | ance/ (ino 265) Send snapshot: | a/ (ino 261)

Re: btrfs device ready non-success exit code

2015-06-04 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 06/04/2015 04:25 PM, Anand Jain wrote: >> typically ready cli is to check disk pool status in an unmounted >> state. On my desktop with btrfs RAID0 on two partitions, the exit code of ready is always 1. On my laptop with btrfs RAID0 on two LUKS/dm

Re: copy complete subvolume/snapshot structure

2015-06-04 Thread Paul Harvey
> 2015-06-04 16:42 GMT+02:00 Richard Michael : >> Hi Johan, [snip] >> Concerning the backup of subvolumes, Snazzer is frequently mentioned. (I >> have not used it myself.) >> >> https://github.com/csirac2/snazzer Just a heads-up: those frequent mentions are entirely down to me trying to gain some

Re: btrfs device ready non-success exit code

2015-06-04 Thread Anand Jain
On 06/05/2015 01:57 AM, Roger Binns wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 This is on current Ubuntu 15.04. What is device ready unhappy with? Note that the root filesystem and /home (both subvolumes of this) are mounted and working perfectly, and even where the commands are run

[PATCH] Btrfs: use received_uuid of parent during send

2015-06-04 Thread Josef Bacik
Neil Horman pointed out a problem where if he did something like this receive A snap A B change B send -p A B and then on another box do recieve A receive B the receive B would fail because we use the UUID of A for the clone sources for B. This makes sense most of the time because normally you

Re: [PATCH 1/5] Btrfs: incremental send, avoid circular waiting and descendant overwrite ancestor need to update path

2015-06-04 Thread Filipe David Manana
On Thu, Jun 4, 2015 at 2:50 PM, Filipe David Manana wrote: > On Thu, Jun 4, 2015 at 12:18 PM, Robbie Ko wrote: >> Base on [PATCH] Btrfs: incremental send, check if orphanized dir inode needs >> delayed rename >> >> Example1: >> There's one case where we can't issue a rename operation for a direc

Please submit specific discussion proposals for the File & Storage miniconf at LPC2015

2015-06-04 Thread Darrick J. Wong
Hi folks, Well, we made it! As of yesterday, the File & Storage systems microconf has been approved for Plumbers! If you're interested in attending, I highly recommend that you register[0] immediately, as the earlybird deadline is tomorrow, June 5th. We have a solid list of discussion ideas on

btrfs device ready non-success exit code

2015-06-04 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 This is on current Ubuntu 15.04. What is device ready unhappy with? Note that the root filesystem and /home (both subvolumes of this) are mounted and working perfectly, and even where the commands are run from. $ sudo btrfs fi show /dev/sda1 Label: '

Re: [PATCH v2] btrfs: Fix lockdep warning of wr_ctx->wr_lock in scrub_free_wr_ctx()

2015-06-04 Thread Filipe David Manana
On Thu, Jun 4, 2015 at 1:09 PM, Zhaolei wrote: > From: Zhao Lei > > lockdep report following warning in test: > [25176.843958] = > [25176.844519] [ INFO: inconsistent lock state ] > [25176.845047] 4.1.0-rc3 #22 Tainted: GW > [25176.845591] -

Re: [PATCH 4/5] Btrfs: incremental send, fix rmdir but dir have a unprocess item

2015-06-04 Thread Filipe David Manana
On Thu, Jun 4, 2015 at 12:18 PM, Robbie Ko wrote: > There's one case where we can't rmdir issue. "There's one case where we attempt to rmdir a directory prematurely." > > Example: > > Parent snapshot: > | a/ (ino 279) > | c (ino 282) > | del/ (ino 281) > | tmp/ (ino 280) >

Re: Stability of Btrfs in Kernel 3.0

2015-06-04 Thread Justin Maggard
Yes, ReadyNAS btrfs is a long way away from 3.0 btrfs. And RN202/204 currently ship with a 3.12 kernel, and will be updated further soon. There are also firmware versions currently available in beta for all other hardware platforms using a much newer kernel, if you'd rather. But anyway, here's a d

Re: [PATCH 3/5] Btrfs: incremental send, fix orphan_dir_info not completely cleared

2015-06-04 Thread Filipe David Manana
On Thu, Jun 4, 2015 at 12:18 PM, Robbie Ko wrote: > There's one case where we not clear orphan_dir_info issue. You mean where we leak a orphan_dir_info structure. > > Example: > > Parent snapshot: > | a/ (ino 279) > | c (ino 282) > | del/ (ino 281) > | tmp/ (ino 280) > |---

Re: [PATCH 5/5] Btrfs: incremental send, fix rmdir not send utimes

2015-06-04 Thread Filipe David Manana
On Thu, Jun 4, 2015 at 12:18 PM, Robbie Ko wrote: > There's one case where we can't issue a utimes operation for a directory. > When 263 will delete, waiting 261 and set 261 rmdir_ino, but 262 earlier > processed and update uime between two parent directory. > So fix this by not update non exist u

Re: [PATCH 2/5] Btrfs: incremental send, avoid ancestor rename to descendant

2015-06-04 Thread Filipe David Manana
On Thu, Jun 4, 2015 at 12:18 PM, Robbie Ko wrote: > Base on [PATCH] Btrfs: incremental send, don't delay directory renames > unnecessarily > > There's one case where we can't issue a rename operation for a directory Should be "There's one more case where..." - we already have at least a handful

Re: Stability of Btrfs in Kernel 3.0

2015-06-04 Thread Maximilian Eschenbacher
Hey Martin, On 04/06/2015 15:55:49, Martin Steigerwald wrote: BTRFS and Kernel 3.0? Unless its has a newer BTRFS version or at least critical fixed backported, I would run away from it. Free space management in Kernel 3.0 still had issues that even with 2 GiB free the filesystem could report i

Re: block: add a bi_error field to struct bio

2015-06-04 Thread Mike Snitzer
On Wed, Jun 03 2015 at 9:42P -0400, Christoph Hellwig wrote: > Currently we have two different ways to signal an I/O error on a BIO: > > (1) by clearing the BIO_UPTODATE flag > (2) by returning a Linux errno value to the bi_end_io callback > > The first one has the drawback of only communica

Re: copy complete subvolume/snapshot structure

2015-06-04 Thread Richard Michael
Hi Johan, No, AFAIK, " send ... | .. receive " will not include subvolumes. This was discussed in various threads on-list in late April/early May. I suggest perusing these: http://thread.gmane.org/gmane.comp.file-systems.btrfs/44459 http://thread.gmane.org/gmane.comp.file-systems.btrfs/44890 htt

Re: copy complete subvolume/snapshot structure

2015-06-04 Thread Johan Kröckel
Thank you! My fault. 2015-06-04 16:42 GMT+02:00 Richard Michael : > Hi Johan, > > This was discussed in various threads on-list in late April/early May. I > suggest perusing these: > > http://thread.gmane.org/gmane.comp.file-systems.btrfs/44459 > http://thread.gmane.org/gmane.comp.file-systems.bt

copy complete subvolume/snapshot structure

2015-06-04 Thread Johan Kröckel
Hello, I am wondering, what is the fastest und most secure way to copy a complete btrfs-volume including the subvolume-structure to another volume? Just btrfs send/receive like this? > btrfs send /vol1|btrfs receive vol2 Thanks in advance Johan -- To unsubscribe from this list: send the line "unsu

Re: Stability of Btrfs in Kernel 3.0

2015-06-04 Thread Martin Steigerwald
Am Donnerstag, 4. Juni 2015, 14:54:48 schrieb Maximilian Eschenbacher: > Greetings, > > I am wondering about the stability of btrfs in this kernel version since > Negear ist selling those ReadyNAS with a buttload of features including > btrfs and linux kernel 3.0. > > Is this a system one can use

Re: [PATCH 1/5] Btrfs: incremental send, avoid circular waiting and descendant overwrite ancestor need to update path

2015-06-04 Thread Filipe David Manana
On Thu, Jun 4, 2015 at 12:18 PM, Robbie Ko wrote: > Base on [PATCH] Btrfs: incremental send, check if orphanized dir inode needs > delayed rename > > Example1: > There's one case where we can't issue a rename operation for a directory > immediately when we process it. > > Parent snapshot: > |

Re: [PATCH 0/5] Btrfs incremental send fix serval case for rename and rm directory

2015-06-04 Thread Filipe David Manana
On Thu, Jun 4, 2015 at 12:18 PM, Robbie Ko wrote: > Patch for fix btrfs send receive. These patches base on v4.1-rc6-49-g8a7deb3 > plus following patches. > [PATCH] Btrfs: incremental send, don't delay directory renames unnecessarily > [PATCH] Btrfs: incremental send, check if orphanized dir inode

Stability of Btrfs in Kernel 3.0

2015-06-04 Thread Maximilian Eschenbacher
Greetings, I am wondering about the stability of btrfs in this kernel version since Negear ist selling those ReadyNAS with a buttload of features including btrfs and linux kernel 3.0. Is this a system one can use to keep backup? Do you have any suggestions on what operations may be cause problem

[PATCH v2] btrfs: Fix lockdep warning of wr_ctx->wr_lock in scrub_free_wr_ctx()

2015-06-04 Thread Zhaolei
From: Zhao Lei lockdep report following warning in test: [25176.843958] = [25176.844519] [ INFO: inconsistent lock state ] [25176.845047] 4.1.0-rc3 #22 Tainted: GW [25176.845591] - [25176.846153] inconsistent {SOFTIRQ-ON

[PATCH 5/5] Btrfs: incremental send, fix rmdir not send utimes

2015-06-04 Thread Robbie Ko
There's one case where we can't issue a utimes operation for a directory. When 263 will delete, waiting 261 and set 261 rmdir_ino, but 262 earlier processed and update uime between two parent directory. So fix this by not update non exist utimes for this case. Example: Parent snapshot: | a/ (

[PATCH 2/5] Btrfs: incremental send, avoid ancestor rename to descendant

2015-06-04 Thread Robbie Ko
Base on [PATCH] Btrfs: incremental send, don't delay directory renames unnecessarily There's one case where we can't issue a rename operation for a directory as soon as we process it. We move a directory from ancestor to descendant, if not wait_parent_move or wait_for_dest_dir_move so that happen

[PATCH 3/5] Btrfs: incremental send, fix orphan_dir_info not completely cleared

2015-06-04 Thread Robbie Ko
There's one case where we not clear orphan_dir_info issue. Example: Parent snapshot: | a/ (ino 279) | c (ino 282) | del/ (ino 281) | tmp/ (ino 280) | long/ (ino 283) | longlong/ (ino 284) Send snapshot: | a/ (ino 279) | long (ino 283) | longlong (i

[PATCH 0/5] Btrfs incremental send fix serval case for rename and rm directory

2015-06-04 Thread Robbie Ko
Patch for fix btrfs send receive. These patches base on v4.1-rc6-49-g8a7deb3 plus following patches. [PATCH] Btrfs: incremental send, don't delay directory renames unnecessarily [PATCH] Btrfs: incremental send, check if orphanized dir inode needs delayed rename Thanks. Robbie Ko (5): Btrfs: in

[PATCH 4/5] Btrfs: incremental send, fix rmdir but dir have a unprocess item

2015-06-04 Thread Robbie Ko
There's one case where we can't rmdir issue. Example: Parent snapshot: | a/ (ino 279) | c (ino 282) | del/ (ino 281) | tmp/ (ino 280) | long/ (ino 283) Send snapshot: | a/ (ino 279) | long (ino 283) | c/ (ino 282) | tmp/ (ino 280) Here we process 28

[PATCH 1/5] Btrfs: incremental send, avoid circular waiting and descendant overwrite ancestor need to update path

2015-06-04 Thread Robbie Ko
Base on [PATCH] Btrfs: incremental send, check if orphanized dir inode needs delayed rename Example1: There's one case where we can't issue a rename operation for a directory immediately when we process it. Parent snapshot: | d/ (ino 257) | p1 (ino 258) | p1/ (ino 259) Send snaps

Re: [PATCH 1/3] btrfs: iterate over unused chunk space in FITRIM

2015-06-04 Thread Holger Hoffstätte
On Wed, 03 Jun 2015 10:47:52 -0400, jeffm wrote: > This patch iterates over the unused chunk space and discards any regions > that are unallocated, regardless of whether they were ever used. This is > a change for btrfs but is consistent with other file systems. > .. [snip] This just gave me: f

Re: [dm-devel] [PATCH] block: add a bi_error field to struct bio

2015-06-04 Thread Martin K. Petersen
> "Christoph" == Christoph Hellwig writes: Christoph> The first one has the drawback of only communicating a single Christoph> possible error (-EIO), and the second one has the drawback of Christoph> not beeing persistent when bios are queued up, and are not Christoph> passed along from child

counting fragments takes more time than defragmenting

2015-06-04 Thread Marc MERLIN
Hi Chris, After our quick chat, I gave it a shot on 3.19.6, and things are better than last time I tried. legolas:/var/local/nobck/VirtualBox VMs# lsattr Win7/ ---C Win7/Logs ---C Win7/Snapshots ---C Win7/Win7.vdi ---C Win7/Win7.png ---C