Re: btrfs send reproducibly fails for a specific subvolume after sending 15 GiB, scrub reports no errors

2015-11-26 Thread Duncan
Hugo Mills posted on Tue, 24 Nov 2015 21:27:46 + as excerpted: [In the context of btrfs send...] >-p only sends the file metadata for the changes from the reference > snapshot to the sent snapshot. -c sends all the file metadata, but will > preserve the reflinks between the sent snapshot

Re: btrfs send reproducibly fails for a specific subvolume after sending 15 GiB, scrub reports no errors

2015-11-24 Thread Filipe Manana
On Sun, Nov 22, 2015 at 9:59 PM, Nils Steinger wrote: > Hi, > > I recently ran into a problem while trying to back up some of my btrfs > subvolumes over the network: > `btrfs send` works flawlessly on snapshots of most subvolumes, but keeps > failing on snapshots of a certain

Re: btrfs send reproducibly fails for a specific subvolume after sending 15 GiB, scrub reports no errors

2015-11-24 Thread Austin S Hemmelgarn
On 2015-11-24 15:50, Christoph Anton Mitterer wrote: On Tue, 2015-11-24 at 15:44 -0500, Austin S Hemmelgarn wrote: I would say it's currently usable for one-shot stuff, but probably not reliably useable for automated things without some kind of administrative oversight. In theory, it wouldn't

Re: btrfs send reproducibly fails for a specific subvolume after sending 15 GiB, scrub reports no errors

2015-11-24 Thread Christoph Anton Mitterer
On Tue, 2015-11-24 at 15:58 -0500, Austin S Hemmelgarn wrote: > I had tried using send/receive once with -p, but had numerous issues.   > The incrementals I've been doing have used -c instead, and I hadn't had  > any issues with data loss with that.  The issue outlined here was only a  > small

Re: btrfs send reproducibly fails for a specific subvolume after sending 15 GiB, scrub reports no errors

2015-11-24 Thread Hugo Mills
On Tue, Nov 24, 2015 at 10:17:13PM +0100, Christoph Anton Mitterer wrote: > On Tue, 2015-11-24 at 15:58 -0500, Austin S Hemmelgarn wrote: > > I had tried using send/receive once with -p, but had numerous issues. >   > > The incrementals I've been doing have used -c instead, and I hadn't had  > >

Re: btrfs send reproducibly fails for a specific subvolume after sending 15 GiB, scrub reports no errors

2015-11-24 Thread Christoph Anton Mitterer
On Tue, 2015-11-24 at 15:44 -0500, Austin S Hemmelgarn wrote: > I would say it's currently usable for one-shot stuff, but probably > not > reliably useable for automated things without some kind of > administrative oversight.  In theory, it wouldn't be hard to write a > script to automate

Re: btrfs send reproducibly fails for a specific subvolume after sending 15 GiB, scrub reports no errors

2015-11-24 Thread Austin S Hemmelgarn
On 2015-11-24 13:48, Christoph Anton Mitterer wrote: Hey. All that sounds pretty serious, doesn't it? So in other words, AFAIU, send/receive cannot really be reliably used. I did so far for making incremental backups, but I've also experienced some problems (though not what this is about

Re: btrfs send reproducibly fails for a specific subvolume after sending 15 GiB, scrub reports no errors

2015-11-24 Thread Christoph Anton Mitterer
On Tue, 2015-11-24 at 21:27 +, Hugo Mills wrote: >    -p only sends the file metadata for the changes from the reference > snapshot to the sent snapshot. -c sends all the file metadata, but > will preserve the reflinks between the sent snapshot and the (one or > more) reference snapshots. Let

Re: btrfs send reproducibly fails for a specific subvolume after sending 15 GiB, scrub reports no errors

2015-11-24 Thread Christoph Anton Mitterer
Hey. All that sounds pretty serious, doesn't it? So in other words, AFAIU, send/receive cannot really be reliably used. I did so far for making incremental backups, but I've also experienced some problems (though not what this is about here). Cheers, Chris. smime.p7s Description: S/MIME

Re: btrfs send reproducibly fails for a specific subvolume after sending 15 GiB, scrub reports no errors

2015-11-24 Thread Hugo Mills
On Tue, Nov 24, 2015 at 10:36:26PM +0100, Christoph Anton Mitterer wrote: > On Tue, 2015-11-24 at 21:27 +, Hugo Mills wrote: > >    -p only sends the file metadata for the changes from the reference > > snapshot to the sent snapshot. -c sends all the file metadata, but > > will preserve the

Re: btrfs send reproducibly fails for a specific subvolume after sending 15 GiB, scrub reports no errors

2015-11-24 Thread Austin S Hemmelgarn
On 2015-11-24 00:42, Duncan wrote: Nils Steinger posted on Mon, 23 Nov 2015 22:10:12 +0100 as excerpted: Do we anything about what might cause a filesystem to enter a state which `send` chokes on? I've only seen a small sample of the corrupted files before growing tired of the process and just

Re: btrfs send reproducibly fails for a specific subvolume after sending 15 GiB, scrub reports no errors

2015-11-23 Thread Austin S Hemmelgarn
On 2015-11-22 16:59, Nils Steinger wrote: Hi, I recently ran into a problem while trying to back up some of my btrfs subvolumes over the network: `btrfs send` works flawlessly on snapshots of most subvolumes, but keeps failing on snapshots of a certain subvolume — always after sending 15 GiB:

Re: btrfs send reproducibly fails for a specific subvolume after sending 15 GiB, scrub reports no errors

2015-11-23 Thread Duncan
Nils Steinger posted on Mon, 23 Nov 2015 22:10:12 +0100 as excerpted: > Do we anything about what might cause a filesystem to enter a state > which `send` chokes on? > I've only seen a small sample of the corrupted files before growing > tired of the process and just recreating the whole thing,

Re: btrfs send reproducibly fails for a specific subvolume after sending 15 GiB, scrub reports no errors

2015-11-23 Thread Nils Steinger
On Mon, Nov 23, 2015 at 05:49:05AM +, Duncan wrote: > Btrfs scrub? Why do you believe it will detect/fix the problem? I was under the impression that btrfs scrub would detect all kinds of inconsistencies (not just data-checksum mismatches), including whatever caused btrfs send to fail.

Re: btrfs send reproducibly fails for a specific subvolume after sending 15 GiB, scrub reports no errors

2015-11-22 Thread Duncan
Nils Steinger posted on Sun, 22 Nov 2015 22:59:36 +0100 as excerpted: > I recently ran into a problem while trying to back up some of my btrfs > subvolumes over the network: > `btrfs send` works flawlessly on snapshots of most subvolumes, but keeps > failing on snapshots of a certain subvolume —

btrfs send reproducibly fails for a specific subvolume after sending 15 GiB, scrub reports no errors

2015-11-22 Thread Nils Steinger
Hi, I recently ran into a problem while trying to back up some of my btrfs subvolumes over the network: `btrfs send` works flawlessly on snapshots of most subvolumes, but keeps failing on snapshots of a certain subvolume — always after sending 15 GiB: btrfs send