Re: Is stability a joke?

2016-09-11 Thread Marc MERLIN
On Sun, Sep 11, 2016 at 02:39:14PM +0200, Waxhead wrote: > That is exactly the same reason I don't edit the wiki myself. I could of > course get it started and hopefully someone will correct what I write, but I > feel that if I start this off I don't have deep enough knowledge to do a > proper star

Re: btrfs and containers

2016-03-09 Thread Marc MERLIN
On Wed, Mar 09, 2016 at 02:21:26PM -0700, Chris Murphy wrote: > > I have a very stripped down docker image that actually mounts portion of > > of my root filesystem read only. > > While it's running out of a btrfs filesystem, you can't run btrfs > > commands against it: > > 05233e5c91f0:/# btrfs fi

Re: btrfs and containers

2016-03-09 Thread Marc MERLIN
On Mon, Mar 07, 2016 at 11:55:47PM +0100, Tobias Hunger wrote: > Hi, > > I have been running systemd-nspawn containers on top of a btrfs > filesystem for a while now. > > This works great: Snapshots are a huge help to manage containers! > > But today I ran btrfs subvol list . *inside* a containe

Re: Documentation for BTRFS error (device dev): bdev /dev/xx errs: wr 22, rd 0, flush 0, corrupt 0, gen 0

2016-03-07 Thread Marc MERLIN
On Tue, Feb 23, 2016 at 01:59:11PM -0800, Marc MERLIN wrote: > I have a freshly created md5 array, with drives that I specifically > scanned one by one block by block, and for good measure, I also scanned > the entire software raid with a check command which took 3 days to run. >

Re: btrfs check --repair is clean, but mount fails

2016-02-28 Thread Marc MERLIN
On Sun, Feb 28, 2016 at 06:49:21AM +, Duncan wrote: > The "defaults" mount option in fstab is just that, the defaults, and > doesn't really apply as an option because they /are/ the defaults. The Yeah, been having this for some 20 years, cut and paste, and I should get used to just removing i

Re: btrfs check --repair is clean, but mount fails

2016-02-27 Thread Marc MERLIN
On Sun, Feb 28, 2016 at 09:44:36AM +0800, Anand Jain wrote: > If you have a choice pls add, 'btrfs fi show -d' as well for the outputs > to be taken at the time of boot just before system's 'btrfs dev scan', Ok, I had to reboot anyway, so here's the state when it's bad: gargamel:~# btrfs fi show

Re: btrfs check --repair is clean, but mount fails

2016-02-27 Thread Marc MERLIN
On Sun, Feb 28, 2016 at 09:44:36AM +0800, Anand Jain wrote: > > Marc, > > > Err, I'm very perplexed now. I already have a scan in my boot process > > after device decrypts. > > Somehow it saw one of my 2 devices, but not the other one? > > If blkid shows both the devices and if you are running '

Re: btrfs check --repair is clean, but mount fails

2016-02-27 Thread Marc MERLIN
On Sat, Feb 27, 2016 at 10:06:06AM -0800, Liu Bo wrote: > Can you grep this message since btrfs dev scan has a "printf("Scanning for > Btrfs filesystems\n");"? > And if a scan failed somehow, it may print an error after this message > and we then know what was happening.. I'm not seeing anything

Re: btrfs check --repair is clean, but mount fails

2016-02-27 Thread Marc MERLIN
On Sun, Feb 28, 2016 at 06:58:00AM +0800, Anand Jain wrote: > Can you log the output of blkid here. If blkid output does > not report all the btrfs devs correctly the kernel won't know > as well. Sure. The relevant entries are at the bottom (last 3 lines). It looks good now of course, but I

Re: btrfs check --repair is clean, but mount fails

2016-02-26 Thread Marc MERLIN
On Fri, Feb 26, 2016 at 06:45:34PM -0800, Liu Bo wrote: > On Fri, Feb 26, 2016 at 06:39:38PM -0800, Marc MERLIN wrote: > > btrfs-tools 4.4-1 > > gargamel:~# uname -r > > 4.4.2-amd64-i915-volpreempt-20160214bc2 > > > > 2 drive array stopped working after a c

btrfs check --repair is clean, but mount fails

2016-02-26 Thread Marc MERLIN
btrfs-tools 4.4-1 gargamel:~# uname -r 4.4.2-amd64-i915-volpreempt-20160214bc2 2 drive array stopped working after a crash/reboot. Check --repair finds nothing wrong with it: gargamel:~# btrfs check --repair /dev/mapper/raid0d1 enabling repair mode Checking filesystem on /dev/mapper/raid0d1 UUID

Can you help explain these OOM crashes?

2016-02-25 Thread Marc MERLIN
Which kind of RAM am I missing? :) Thanks, Marc [46320.200703] btrfs: page allocation failure: order:1, mode:0x2204020 [46320.221174] CPU: 7 PID: 12576 Comm: btrfs Not tainted 4.4.2-amd64-i915-volpreempt-20160213bc1 #3 [46320.249161] Hardware name: System manufacturer System Product Name/P8H67-M

Re: Input/Output errors

2016-02-23 Thread Marc MERLIN
On Tue, Feb 23, 2016 at 08:40:46PM -0400, Kenny MacDermid wrote: > I'm running btrfs on DM-Crypt Luks running on LVM. > > Occasionally I get files that are unreadable for some period of time. > Attempting to read from them results in an > > Input/output error > > Sometimes they'll come back on

Re: Documentation for BTRFS error (device dev): bdev /dev/xx errs: wr 22, rd 0, flush 0, corrupt 0, gen 0

2016-02-23 Thread Marc MERLIN
On Tue, Feb 23, 2016 at 11:22:47PM +, Duncan wrote: > Forgot to mention, tho you're probably already considering it, if this is > the same raid5-backed btrfs you were complaining about being slow in the > other thread, No, that's another one :) This one was remade from scratch after the fil

Documentation for BTRFS error (device dev): bdev /dev/xx errs: wr 22, rd 0, flush 0, corrupt 0, gen 0

2016-02-23 Thread Marc MERLIN
I have a freshly created md5 array, with drives that I specifically scanned one by one block by block, and for good measure, I also scanned the entire software raid with a check command which took 3 days to run. Everything passed. Then, I made a bcache of that device, an ssd that seems to work fi

Re: Major HDD performance degradation on btrfs receive

2016-02-23 Thread Marc MERLIN
On Tue, Feb 23, 2016 at 07:01:52PM +0100, Lionel Bouton wrote: > Why don't you use autodefrag ? If you have writable snapshots and do > write to them heavily it would not be a good idea (depending on how > BTRFS handles this in most cases you would probably either break the > reflinks or fragment a

Re: Major HDD performance degradation on btrfs receive

2016-02-23 Thread Marc MERLIN
On Tue, Feb 23, 2016 at 09:26:35AM -0800, Marc MERLIN wrote: > Label: 'dshelf2' uuid: d4a51178-c1e6-4219-95ab-5c5864695bfd > Total devices 1 FS bytes used 4.25TiB > devid1 size 7.28TiB used 4.44TiB path /dev/mapper/dshelf2 > > btrfs fi df /mnt/bt

Re: Major HDD performance degradation on btrfs receive

2016-02-23 Thread Marc MERLIN
Well, since we're on the topic, my backup server btrfs FS has become so slow that it hangs my system a few seconds here and there and causes some of my cron jobs to fail. I'm going to re-create it for a 3 time (in 3 years), adding bcache this time, but clearly there is a good chance that this file

Re: Fun BTRFS Stuff:

2016-02-22 Thread Marc MERLIN
On Mon, Feb 22, 2016 at 02:45:49PM -0600, Terrance Harris wrote: > Hello, > > I'm a btrfs novice, but i've been using it for a few years now on > openSUSE Tumblweed. Howdy. First, please use the linux-btrfs@vger.kernel.org mailing list > Is there a way to convert snaBpshots into mountable file

Re: btrfs-image failure (btrfs-tools 4.4)

2016-02-15 Thread Marc MERLIN
On Mon, Feb 15, 2016 at 08:17:32AM +0800, Qu Wenruo wrote: > Sorry for the late reply. > > According to the output of your btrfsck --repair output, things just get > worse. > > So at this point, it's harder to locate the original problem. (Csum > missing with bad file extents) > > IMHO you can

Re: btrfs on top of bcache on top of dmcrypt on top of md raid5

2016-02-14 Thread Marc MERLIN
On Sun, Feb 14, 2016 at 01:43:05PM -0700, Chris Murphy wrote: > Use all defaults for everything. Anything new by show should do the > right thing including 4096 byte alignment. > > gargamel:~# cryptsetup luksDump /dev/md8 > [snip] > Payload offset: 3072 > > This is a bit weird because the default

Re: Is there now a way to migrate FS without losing shared COW blocks between subvolumes?

2016-02-14 Thread Marc MERLIN
On Sat, Feb 13, 2016 at 12:28:13PM +, Duncan wrote: > Marc MERLIN posted on Fri, 12 Feb 2016 19:28:46 -0800 as excerpted: > > > btrfs send lets you keep COW blocks within a subvolume. > > But if I have lots of backups where subvolumes have shared data, and I > > need

Re: btrfs-image failure (btrfs-tools 4.4)

2016-02-14 Thread Marc MERLIN
On Fri, Feb 12, 2016 at 09:26:28AM -0800, Marc MERLIN wrote: > On Fri, Feb 12, 2016 at 08:33:11AM +0800, Qu Wenruo wrote: > > There is still a last chance. > > > > If btrfsck still report original error about "bad file extent" in root: > > 45851/45852/... &g

Is there now a way to migrate FS without losing shared COW blocks between subvolumes?

2016-02-12 Thread Marc MERLIN
btrfs send lets you keep COW blocks within a subvolume. But if I have lots of backups where subvolumes have shared data, and I need to migrate this to a new filesystem, is there a decent way? I know I can btrfs device add new drive as raid1, but I'm trying to migrate off an old filesystem that lik

Re: btrfs-image failure (btrfs-tools 4.4)

2016-02-12 Thread Marc MERLIN
On Fri, Feb 12, 2016 at 08:33:11AM +0800, Qu Wenruo wrote: > There is still a last chance. > > If btrfsck still report original error about "bad file extent" in root: > 45851/45852/... > Btrfs-debug-tree may provide useful info by dumping only that root. > > # btrfs-debug-tree -t 45851 > > But

btrfs on top of bcache on top of dmcrypt on top of md raid5

2016-02-12 Thread Marc MERLIN
I have a 5 drive md array with dmcrypt on top, and btrfs on top of that. Kernel: 4.4 but the filesystem was created 2 years ago with an older version of btrfs. It's littered with files and hardlinks (it's a backup server). Mostly it gets btrfs receive data, and rsyncs of filesystem trees that are o

Re: btrfs-image failure (btrfs-tools 4.4)

2016-02-11 Thread Marc MERLIN
On Thu, Feb 11, 2016 at 07:09:47AM -0800, Marc MERLIN wrote: > On Thu, Feb 11, 2016 at 03:16:47PM +0800, Qu Wenruo wrote: > > >I started making a dump, image was growing past 3GB, and then it failed > > >and the image got deleted: > > > > > >gargamel:~# btr

Re: btrfs-image failure (btrfs-tools 4.4)

2016-02-11 Thread Marc MERLIN
On Thu, Feb 11, 2016 at 03:16:47PM +0800, Qu Wenruo wrote: > >I started making a dump, image was growing past 3GB, and then it failed > >and the image got deleted: > > > >gargamel:~# btrfs-image -s -c 9 /dev/mapper/dshelf1old > >/mnt/dshelf1/ds1old.dump > >Error adding space cache blocks -5 > > I

Re: btrfs-image failure (btrfs-tools 4.4)

2016-02-10 Thread Marc MERLIN
On Tue, Jan 26, 2016 at 09:03:07AM +0800, Qu Wenruo wrote: > If the fs is small enough, would you please do a btrfs-image dump? > That would help a lot to locate the direct cause. I started making a dump, image was growing past 3GB, and then it failed and the image got deleted: gargamel:~# btrfs

Re: btrfs-progs 4.4 re-balance of RAID6 is very slow / limited to one cpu core?

2016-02-09 Thread Marc MERLIN
On Tue, Feb 09, 2016 at 02:48:14PM +0100, Christian Rohmann wrote: > > > On 02/01/2016 09:52 PM, Chris Murphy wrote: > >> Would some sort of stracing or profiling of the process help to narrow > >> > down where the time is currently spent and why the balancing is only > >> > running single-thread

Re: Still not production ready

2015-12-13 Thread Marc MERLIN
On Sun, Dec 13, 2015 at 11:35:08PM +0100, Martin Steigerwald wrote: > Hi! > > For me it is still not production ready. Again I ran into: > > btrfs kworker thread uses up 100% of a Sandybridge core for minutes on random > write into big file > https://bugzilla.kernel.org/show_bug.cgi?id=90401 S

Re: Scrub: no spae left on device

2015-12-08 Thread Marc MERLIN
On Tue, Dec 08, 2015 at 05:24:16PM +0100, Holger Hoffstätte wrote: > On 12/08/15 17:06, Marc MERLIN wrote: > > Label: 'btrfs_pool1' uuid: 5ee24229-2431-448a-868e-2c325d10bfa7 > > Total devices 1 FS bytes used 524.26GiB > > devid1 size 615.01GiB used 6

Re: Scrub: no spae left on device

2015-12-08 Thread Marc MERLIN
On Tue, Dec 08, 2015 at 04:46:32PM +0100, Lionel Bouton wrote: > Le 08/12/2015 16:37, Holger Hoffstätte a écrit : > > On 12/08/15 16:06, Marc MERLIN wrote: > >> Howdy, > >> > >> Why would scrub need space and why would it cancel if there isn't enough of

Scrub: no spae left on device

2015-12-08 Thread Marc MERLIN
Howdy, Why would scrub need space and why would it cancel if there isn't enough of it? (kernel 4.3) /etc/cron.daily/btrfs-scrub: btrfs scrub start -Bd /dev/mapper/cryptroot scrub device /dev/mapper/cryptroot (id 1) done scrub started at Mon Dec 7 01:35:08 2015 and finished after 258 seco

Re: Where is the disk space?

2015-11-15 Thread Marc MERLIN
On Sat, Nov 14, 2015 at 10:35:39PM -0800, Liu Bo wrote: > Since you said you have some snapshots in between...I can think of one > case to prove where the space goes, > > Say, you have a file with size=10M on a freshly created partition(the total > used data space is 10M), and you have a snapshot

Re: Where is the disk space?

2015-11-13 Thread Marc MERLIN
On Fri, Nov 13, 2015 at 07:45:21PM +, Duncan wrote: > Marc MERLIN posted on Fri, 13 Nov 2015 09:41:01 -0800 as excerpted: > > > Any ideas? > > Without addressing the main question, a couple targets of opportunity: > > 1) A quick balance with -mprofiles=single should

Where is the disk space?

2015-11-13 Thread Marc MERLIN
root@polgara:/mnt/btrfs_root# du -sh * 28G @ 28G @_hourly.20151113_08:04:01 4.0K@_last 4.0K@_last_rw 28G @_rw.20151113_00:02:01 root@polgara:/mnt/btrfs_root# df -h . Filesystem Size Used Avail Use% Mounted on /dev/sdb556G 40G 5.4G 89% /mnt/btrfs_root root@polg

Re: btrfs kernel hang? (4.1.3)

2015-10-06 Thread Marc MERLIN
On Mon, Oct 05, 2015 at 10:40:34PM -0700, Marc MERLIN wrote: > I started doing multiple mencoder/ffmpeg commands, and as I ran one > more, the system froze up (as in everything froze, even running ssh > sessions not doing any IO) > > sysrq-W output: > http://marc.merlins.org/t

btrfs kernel hang? (4.1.3)

2015-10-05 Thread Marc MERLIN
I started doing multiple mencoder/ffmpeg commands, and as I ran one more, the system froze up (as in everything froze, even running ssh sessions not doing any IO) sysrq-W output: http://marc.merlins.org/tmp/sysrq_4.1.3.txt I'm assuming btrfs is to blame, but I'm not certain. Hopefully someone kno

Re: Btrfs partition gets remounted as read only

2015-09-21 Thread Marc MERLIN
On Mon, Sep 21, 2015 at 02:30:21PM +, Incorporeal Waffle wrote: > I tried converting my root partition (originally ext4) to btrfs. > > When I booted, I discovered that my root partition is getting > remounted as read only. I'm afraid, last I heard, the ext4 convertion stuff was broken, and ha

Re: Btrfs tragedy: lack of space for metadata leads to loss of fs.

2015-08-25 Thread Marc MERLIN
On Tue, Aug 25, 2015 at 01:44:12PM +, Miguel Negrão wrote: > Hi list, > > This weekend had my first btrfs horror story. > > system: 3.13.0-49-lowlatency, btrfs-progs v4.1.2 Sorry to say, but that's a very old kernels with many btrfs bugs, some did lead to corruption. > A disclaimer: I kno

Re: kernel BUG at fs/btrfs/extent-tree.c:8113! (4.1.3 kernel)

2015-08-24 Thread Marc MERLIN
On Tue, Aug 25, 2015 at 02:00:32PM +0800, Qu Wenruo wrote: > Thanks for all your work and patient Marc, Haha, no problem, you're doing a lot more work than I am :) > Good to know there is backup. > But as there is no higher generation one, so I'd assume that's not a > normal transaction id failu

Re: kernel BUG at fs/btrfs/extent-tree.c:8113! (4.1.3 kernel)

2015-08-24 Thread Marc MERLIN
On Tue, Aug 25, 2015 at 10:51:00AM +0800, Qu Wenruo wrote: > Patches sent and CCed to you. > > Please try the two patches and see what's new. > This time, I think the output will be much larger. Indeed. However the bad news is that gen 39538 is the highest. Should I force btrfsck to work with an

Re: kernel BUG at fs/btrfs/extent-tree.c:8113! (4.1.3 kernel)

2015-08-24 Thread Marc MERLIN
On Mon, Aug 24, 2015 at 01:11:26PM +0800, Qu Wenruo wrote: > So, my last bet will be, using "btrfs-find-root -a" to find the root > with highest generation, and use the new root to exec "btrfsck -b > ". > The latest btrfs-find-root would output possible tree root by > descending order of its gene

Re: kernel BUG at fs/btrfs/extent-tree.c:8113! (4.1.3 kernel)

2015-08-23 Thread Marc MERLIN
On Mon, Aug 24, 2015 at 09:10:30AM +0800, Qu Wenruo wrote: > Would you please take the following output? > > 1) btrfs check output > With error message if it happens. myth:~# btrfs check /dev/mapper/crypt_sdd1 Checking filesystem on /dev/mapper/crypt_sdd1 UUID: 024ba4d0-dacb-438d-9f1b-eeb34083fe

Re: kernel BUG at fs/btrfs/extent-tree.c:8113! (4.1.3 kernel)

2015-08-22 Thread Marc MERLIN
On Mon, Aug 17, 2015 at 07:49:04AM -0700, Marc MERLIN wrote: > On Mon, Aug 17, 2015 at 10:01:16AM +0800, Qu Wenruo wrote: > > Hi Marc, > > Hi Qu, thanks for your answer and looking at this. > > > Did btrfs-debug-tree also has the crash? > > > > If not, woul

Re: kernel BUG at fs/btrfs/extent-tree.c:8113! (4.1.3 kernel)

2015-08-17 Thread Marc MERLIN
] btrfs-debug-tree(main+0x8b5)[0x804dfb7] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xb757c4d3] btrfs-debug-tree[0x804e221] Do you want the actual output? (it's 1.1GB uncompressed) Marc > Thanks, > Qu > > Marc MERLIN wrote on 2015/08/12 10:19 -0700: > >On Wed,

Re: kernel BUG at fs/btrfs/extent-tree.c:8113! (4.1.3 kernel)

2015-08-12 Thread Marc MERLIN
On Wed, Aug 12, 2015 at 12:18:45PM -0400, Josef Bacik wrote: > Going to need more info to figure this one out Thanks for the patch, here's the output: enabling repair mode Checking filesystem on /dev/mapper/crypt_sdd1 UUID: 024ba4d0-dacb-438d-9f1b-eeb34083fe49 checking extents wtf, parent 5757084

Re: kernel BUG at fs/btrfs/extent-tree.c:8113! (4.1.3 kernel)

2015-08-12 Thread Marc MERLIN
On Wed, Aug 12, 2015 at 11:15:39AM -0400, Josef Bacik wrote: > On 08/12/2015 10:47 AM, Marc MERLIN wrote: > >On Tue, Aug 11, 2015 at 11:40:45AM -0400, Josef Bacik wrote: > >> From a48cf7a9ae44a17d927df5542c8b0be287aee9ed Mon Sep 17 00:00:00 2001 > >>From: Josef Bacik &g

Re: kernel BUG at fs/btrfs/extent-tree.c:8113! (4.1.3 kernel)

2015-08-12 Thread Marc MERLIN
On Tue, Aug 11, 2015 at 11:40:45AM -0400, Josef Bacik wrote: > From a48cf7a9ae44a17d927df5542c8b0be287aee9ed Mon Sep 17 00:00:00 2001 > From: Josef Bacik > Date: Tue, 11 Aug 2015 11:39:37 -0400 > Subject: [PATCH] Btrfs: kill BUG_ON() in btrfs_lookup_extent_info() > > Replace it with an ASSERT(0)

Re: kernel BUG at fs/btrfs/extent-tree.c:8113! (4.1.3 kernel)

2015-08-10 Thread Marc MERLIN
On Sun, Aug 02, 2015 at 08:51:30PM -0700, Marc MERLIN wrote: > On Fri, Jul 24, 2015 at 09:24:46AM -0700, Marc MERLIN wrote: > > > > > Screenshot: http://marc.merlins.org/tmp/btrfs_crash.jpg > > > > > > So it's 32bit system, 3.19.8, crashing during snapsho

Re: ext4 convert bugs, wiki warning?

2015-08-03 Thread Marc MERLIN
On Sat, Aug 01, 2015 at 02:48:41PM -0600, Chris Murphy wrote: > On Sat, Aug 1, 2015 at 2:42 PM, Hugo Mills wrote: > > On Sat, Aug 01, 2015 at 11:29:40AM -0600, Chris Murphy wrote: > >> Does someone with wiki edit capability want to put up a warning about > >> btrfs-convert problems? I don't think

Re: kernel BUG at fs/btrfs/extent-tree.c:8113! (4.1.3 kernel)

2015-08-02 Thread Marc MERLIN
On Fri, Jul 24, 2015 at 09:24:46AM -0700, Marc MERLIN wrote: > > > > Screenshot: http://marc.merlins.org/tmp/btrfs_crash.jpg > > > > So it's 32bit system, 3.19.8, crashing during snapshot deletion and > > backref walking. EIP is in do_walk_down+0x142. I've

Re: Btrfs progs release 4.1.1

2015-07-24 Thread Marc MERLIN
On Thu, Jul 23, 2015 at 01:55:59PM +0200, David Sterba wrote: > On Sat, Jul 11, 2015 at 06:02:29PM -0700, Marc MERLIN wrote: > > Are you interested in crash reports for fsck? > > > > If so, see my recent message: > > > > On Mon, Jul 06, 2015 at 02

Re: Anyone tried out btrbk yet?

2015-07-15 Thread Marc MERLIN
On Wed, Jul 15, 2015 at 01:02:29PM -0500, Donald Pearson wrote: > BTW, is anybody else experiencing btrfs-cleaner consuming heavy > resources for a very long time when snapshots are removed? Yes, that's normal. It spends a long time to reclaim blocks and free them, especially if they are on a har

Re: Anyone tried out btrbk yet?

2015-07-15 Thread Marc MERLIN
On Wed, Jul 15, 2015 at 09:42:28AM -0500, Donald Pearson wrote: > Implementation question about your scripts Marc.. make sure you Cc me then, I could have missed that Email :) > I've set up some routines for different backup and retention intervals > and periods in cron but quickly ran in to step

Re: Anyone tried out btrbk yet?

2015-07-14 Thread Marc MERLIN
On Wed, Jul 15, 2015 at 10:03:16AM +1000, Paul Harvey wrote: > The way it works in snazzer (and btrbk and I think also btrfs-sxbackup > as well), local snapshots continue to happen as normal (Eg. daily or > hourly) and so when your backup media or backup server is finally > available again, the siz

Re: Anyone tried out btrbk yet?

2015-07-12 Thread Marc MERLIN
On Sat, Jul 11, 2015 at 08:55:23PM -0700, Marc MERLIN wrote: > On Fri, Jul 10, 2015 at 12:46:24PM +0200, Axel Burri wrote: > > On 2015-07-09 14:26, Martin Steigerwald wrote: > > > > > Well I may try it for one of my BTRFS volumes in addition to the rsync > > >

Re: Anyone tried out btrbk yet?

2015-07-11 Thread Marc MERLIN
On Fri, Jul 10, 2015 at 12:46:24PM +0200, Axel Burri wrote: > On 2015-07-09 14:26, Martin Steigerwald wrote: > > > Well I may try it for one of my BTRFS volumes in addition to the rsync > > backup for now. I would like to give all options on command line, but well, > > maybe it can completely re

Re: Btrfs progs release 4.1.1

2015-07-11 Thread Marc MERLIN
- fix wrong nbytes Are you interested in crash reports for fsck? If so, see my recent message: On Mon, Jul 06, 2015 at 02:21:56PM -0700, Marc MERLIN wrote: > > myth:~# btrfs check --repair /dev/mapper/crypt_sdd1 > enabling repair mode > Checking filesystem on /dev/mapper/crypt_sdd1 >

Re: Anyone tried out btrbk yet?

2015-07-09 Thread Marc MERLIN
On Thu, Jul 09, 2015 at 02:26:55PM +0200, Martin Steigerwald wrote: > Hi! > > I see Alex, the developer of btrbk posted here once about btrfs send and > receive, but well any other users of btrbk¹? What are your experiences? > > I consider switching to it from my home grown rsync based backup sc

btrfs check --repair crash, and btrfs-cleaner crash

2015-07-06 Thread Marc MERLIN
myth:~# btrfs check --repair /dev/mapper/crypt_sdd1 enabling repair mode Checking filesystem on /dev/mapper/crypt_sdd1 UUID: 024ba4d0-dacb-438d-9f1b-eeb34083fe49 checking extents cmds-check.c:4486: add_data_backref: Assertion `back->bytes != max_size` failed. btrfs[0x8066a73] btrfs[0x8066aa4] btr

Re: btrfs partition converted from ext4 becomes read-only minutes after booting: WARNING: CPU: 2 PID: 2777 at ../fs/btrfs/super.c:260 __btrfs_abort_transaction+0x4b/0x120

2015-06-25 Thread Marc MERLIN
On Thu, Jun 25, 2015 at 08:17:12PM +, Ruslanas Gžibovskis wrote: > nope. started from scratch! never upgrade from old running fs. Better to > move 1 file and extend , move another files, extend and so on then just > convert... It's like moving from windows and only boot partition to have on > e

Re: btrfs partition converted from ext4 becomes read-only minutes after booting: WARNING: CPU: 2 PID: 2777 at ../fs/btrfs/super.c:260 __btrfs_abort_transaction+0x4b/0x120

2015-06-24 Thread Marc MERLIN
On Thu, Jun 18, 2015 at 02:05:04PM +0300, Robert Munteanu wrote: > On Wed, Jun 17, 2015 at 8:46 PM, Marc MERLIN wrote: > > On Fri, Jun 12, 2015 at 03:19:06PM +0300, Robert Munteanu wrote: > >> Hi, > > > > Note to others: kernel 4.0.4 > > > > Reply to you:

Re: 3.19.8: kernel BUG at fs/btrfs/extent_io.c:4548!

2015-06-24 Thread Marc MERLIN
On Wed, Jun 24, 2015 at 06:38:42PM -0700, Marc MERLIN wrote: > Known already fixed problem, or not? > > [680279.909435] kernel BUG at fs/btrfs/extent_io.c:4548! > [680279.926208] invalid opcode: [#1] SMP After reboot, I'm now seeing this if that helps: [ 272.826942] BTRFS

3.19.8: kernel BUG at fs/btrfs/extent_io.c:4548!

2015-06-24 Thread Marc MERLIN
Known already fixed problem, or not? [680279.909435] kernel BUG at fs/btrfs/extent_io.c:4548! [680279.926208] invalid opcode: [#1] SMP [680279.940494] Modules linked in: udp_diag tcp_diag inet_diag loop veth ip6table_filter ip6_tables ebtable_nat ebtables ppdev lp xt_addrtype bridge stp llc

Re: Question about "btrfs send/receive"

2015-06-23 Thread Marc MERLIN
On Wed, Jun 24, 2015 at 11:40:21AM +0800, Cao jin wrote: > Hi Marc, > I can`t access /perso/btrfs/2014-03.html on that server. But I > guess it has similar content as > https://btrfs.wiki.kernel.org/index.php/Incremental_Backup ? > If so, I am afraid incremental backup not suitable for a AP

Re: Question about "btrfs send/receive"

2015-06-23 Thread Marc MERLIN
On Tue, Jun 23, 2015 at 03:15:23PM +0800, Cao jin wrote: > Hi all, > I am considering implement the btrfs send/receive command in > libguestfs(http://libguestfs.org/), and found that incremental send > seems pretty complicated. So my questions is: > 1. What is the most usually usage of btrfs

Re: counting fragments takes more time than defragmenting

2015-06-23 Thread Marc MERLIN
from 104K. Are others seeing similar things? Marc On Thu, Jun 04, 2015 at 05:42:45PM +0900, Marc MERLIN wrote: > Hi Chris, > > After our quick chat, I gave it a shot on 3.19.6, and things are better > than last time I tried. > > legolas:/var/local/nobck/Virt

Re: How do I make 'btrfs scrub' report errors via email?

2015-06-17 Thread Marc MERLIN
On Thu, Jun 18, 2015 at 09:56:09AM +0900, crocket wrote: > I think that's not going to report only errors. Outside of saying how long the scrub took, that's all it does. If you're not quite happy with the output, grep -v is your friend :) Marc -- "A mouse is a device used to point at the xterm

Re: btrfs differential receive has become excrutiatingly slow on one machine

2015-06-17 Thread Marc MERLIN
On Wed, Jun 17, 2015 at 10:58:05AM -0700, Marc MERLIN wrote: > You requested strace -T in the past. I'm showing an exerpt of system calls > that take > more than 1 second. > > When I see this, I get worried: > truncate("/mnt/btrfs_pool2/backup/debian64/legolas/varcha

Re: btrfs differential receive has become excrutiatingly slow on one machine

2015-06-17 Thread Marc MERLIN
On Wed, May 13, 2015 at 12:35:20PM +0100, Filipe David Manana wrote: > > It's a broad question, but how can I diagnose btrfs send being so slow > > without taking the risk of killing my connection? > > (if there is no good answer on this one, I can try another sync later > > with -vvv and strace if

Re: How do I make 'btrfs scrub' report errors via email?

2015-06-17 Thread Marc MERLIN
On Sat, Jun 13, 2015 at 10:48:35PM +0900, crocket wrote: > I can check the result of 'btrfs scrub' later, but I don't want to > take time to actually check it. > Does anyone know how to make 'btrfs scrub' report errors via email? > It seems google doesn't know. See the bottom of: http://marc.merli

Re: btrfs partition converted from ext4 becomes read-only minutes after booting: WARNING: CPU: 2 PID: 2777 at ../fs/btrfs/super.c:260 __btrfs_abort_transaction+0x4b/0x120

2015-06-17 Thread Marc MERLIN
On Fri, Jun 12, 2015 at 03:19:06PM +0300, Robert Munteanu wrote: > Hi, Note to others: kernel 4.0.4 Reply to you: I tried ext4 to btrfs once a year ago and it severely mangled my filesystem. I looked at it as a cool feature/hack that may have worked some time ago, but that no one really uses any

Re: BTRFS: read error corrected: ino 1 off 226840576 (dev /dev/mapper/dshelf1 sector 459432)

2015-06-17 Thread Marc MERLIN
On Wed, Jun 17, 2015 at 01:51:26PM +, Duncan wrote: > > Also, if my actual data got corrupted, am I correct that btrfs will > > detect the checksum failure and give me a different error message of a > > read error that cannot be corrected? > > > > I'll do a scrub later, for now I have to wait

BTRFS: read error corrected: ino 1 off 226840576 (dev /dev/mapper/dshelf1 sector 459432)

2015-06-17 Thread Marc MERLIN
I had a few power offs due to a faulty power supply, and my mdadm raid5 got into fail mode after 2 drives got kicked out since their sequence numbers didn't match due to the abrupt power offs. I brought the swraid5 back up by force assembling it with 4 drives (one was really only a few sequence nu

counting fragments takes more time than defragmenting

2015-06-04 Thread Marc MERLIN
Hi Chris, After our quick chat, I gave it a shot on 3.19.6, and things are better than last time I tried. legolas:/var/local/nobck/VirtualBox VMs# lsattr Win7/ ---C Win7/Logs ---C Win7/Snapshots ---C Win7/Win7.vdi ---C Win7/Win7.png ---C

470 out of about 411 chunks balanced (626 considered), -14% left

2015-05-09 Thread Marc MERLIN
kernel: 3.19.6 btrfs-tools 4.0 git Cosmetic but just in case anyone would like to know: 440 out of about 411 chunks balanced (596 considered), -7% left 442 out of about 411 chunks balanced (598 considered), -8% left 444 out of about 411 chunks balanced (600 considered), -8% left 450 out of abou

Re: 3.19.3: check tree block failed + WARNING: device 0 not present on scrub

2015-05-04 Thread Marc MERLIN
On Sat, May 02, 2015 at 09:30:10AM -0700, Marc MERLIN wrote: > btrfs-debug-tree -t 2 /dev/mapper/cryptroot 2>&1 | tee /tmp/debug_2.txt > > leaf 372551614464 items 125 free space 7363 generation 1911640 owner 2 > fs uuid 79a9a6c7-0955-4820-b81e-0c0681a657c1 > chunk uuid a

Re: 3.19.3: check tree block failed + WARNING: device 0 not present on scrub

2015-05-02 Thread Marc MERLIN
On Sat, May 02, 2015 at 12:50:14PM -0400, Christian Dysthe wrote: > Mine is still doing it. This is from today's log: > > /etc/cron.daily/btrfs-scrub: > WARNING: device 0 not present > scrub device /dev/sda3 (id 1) done > scrub started at Sat May 2 08:03:46 2015 and finished after 241 secon

3.19.3, btrfs send/receive error: failed to clone extents

2015-04-29 Thread Marc MERLIN
I'm getting this from my send/receive job. I'm just going to delete that one file since I don't need it anyway, but is this a known problem or something that would need more info from me? ERROR: failed to clone extents to merlin/.config/google-chrome-beta-42/Default/Application Cache/Cache/data

Re: raid0 needs mounting alternate device every boot? open_ctree failed (3.19.5)

2015-04-26 Thread Marc MERLIN
On Sun, Apr 26, 2015 at 03:32:26PM +, Hugo Mills wrote: >The usual reason for this is that btrfs dev scan isn't being run > properly. It's usually handled by udev -- most distributions will put > the appropriate hooks in their udev configuration if you have the > distribution's btrfs-progs

raid0 needs mounting alternate device every boot? open_ctree failed (3.19.5)

2015-04-26 Thread Marc MERLIN
This is the weirdest thing: gargamel:/var/log# mount /dev/mapper/raid0d2 /mnt/btrfs_space mount: wrong fs type, bad option, bad superblock on /dev/mapper/raid0d2, missing codepage or helper program, or other error In some cases useful info is found in syslog - try dmesg | tail

Re: btrfs subvolume diff

2015-04-22 Thread Marc MERLIN
On Thu, Apr 23, 2015 at 03:43:35AM +, Duncan wrote: > Thomas Koch posted on Wed, 22 Apr 2015 18:08:30 +0200 as excerpted: > > > for incremental backups it would be useful to know the files that > > changed between two snapshots. I found a paper about such a tool[1] that > > adds the "btrfs sub

Is btrfs on top of bcache stable now?

2015-04-20 Thread Marc MERLIN
On Mon, Apr 20, 2015 at 10:27:05AM +, Hugo Mills wrote: >See the first issue here: https://btrfs.wiki.kernel.org/index.php/Gotchas Hi Hugo, looking at the page again, I see "bcache + btrfs does not seem to be stable yet" linking to a thread more than 2 years old and btrfs kernels that wou

Re: corruption in USB harddrive - backup via send/receive - question

2015-04-16 Thread Marc MERLIN
On Thu, Apr 16, 2015 at 06:48:43PM +, Miguel Negrão wrote: > Hello, > > I'm running a laptop, macbook pro 8,2, with ubuntu, on kernel > 3.13.0-49-lowlatency. I have a USB enclosure containing two harddrives Btrfs send/receive is not known to work well enough until 3.14.x, and several corrupti

Re: [PATCH 1/1] btrfs-progs: improve troubleshooting avoid duplicate error strings

2015-04-13 Thread Marc MERLIN
On Mon, Apr 13, 2015 at 08:37:01PM +0800, Anand Jain wrote: > my troubleshooting experience says have unique error string per module. +1 to that, thank you. Marc > In the below eg, its one additional step to know error line, > > cat -n cmds-device.c | egrep "error removing the device" >185

Re: BTRFS corruption w/kernel 3.13 while using docker -s btrfs

2015-04-09 Thread Marc MERLIN
Thank you for trying btrfs, it's great for snapshots in docker, but outside of the 2 helpful comments you already got, do yourself a favour and use a newer kernel. Btrfs moves fast, and 3.13 is way too old. The number of bugs (including corruption bugs) that has been fixed since then is too long t

Re: Btrfs on top of LUKS (dm-crypt)

2015-03-30 Thread Marc MERLIN
On Wed, Jan 14, 2015 at 05:09:28PM -0700, Chris Murphy wrote: > Following the trail backward leads to this one > http://wiki.drewhess.com/wiki/Creating_an_encrypted_filesystem_on_a_partition > > Which has a subheading "md RAID array" that starts out: > > "If the device to be encrypted is an md RA

Re: New tool to recursive compress / decompress of files

2015-03-21 Thread Marc MERLIN
On Sat, Mar 21, 2015 at 07:26:41PM +0100, Petr Bena wrote: > There is a dozen of cases where you want to just compress some folders > in your system, but you don't want to compress whole device, would you > create a subvolume for each of them? Actually with the previous reply you got, I'm not sur

Re: Btrfs on top of LUKS (dm-crypt)

2015-01-14 Thread Marc MERLIN
On Mon, Jan 12, 2015 at 05:02:00PM +0100, Patrik Lundquist wrote: > Hi, > > I've been looking at recommended cryptsetup options for Btrfs and I > have one question: > > Marc uses "cryptsetup luksFormat --align-payload=1024" directly on a > disk partition and not on e.g. a striped mdraid. Is there

Re: ignoring bad blocks

2015-01-04 Thread Marc MERLIN
On Sun, Jan 04, 2015 at 01:45:41AM -0700, Chris Murphy wrote: > On Sat, Jan 3, 2015 at 10:40 PM, Dyweni - BTRFS > wrote: > > Hi All, > > > > Can BTRFS ignore bad blocks as they are discovered? > > > > I want to try BTRFS on some older drives, but they all have a few bad > > blocks. > > Not curre

Re: [PATCH] Btrfs: don't delay inode ref updates during log replay

2015-01-01 Thread Marc MERLIN
Chris, you rule, I applied this to 3.16.7 and my problem went away. Tested-By: Marc MERLIN Happy new year! :) Marc On Wed, Dec 31, 2014 at 01:30:13PM -0500, Chris Mason wrote: > Commit 1d52c78afbb (Btrfs: try not to ENOSPC on log replay) added a > check to skip delayed inode updates

Re: 3.16.3: fs/btrfs/delayed-inode.c:1410 btrfs_assert_delayed_root_empty

2014-12-29 Thread Marc MERLIN
On Mon, Dec 29, 2014 at 10:17:00AM -0500, Chris Mason wrote: > I've hit this recently on my laptop, and haven't yet been able to > recreate it on a machine where I can debug things. The messages are > an error in the log tree replay code, and I don't think they are > actually related to any corrup

Re: 3.16.3: fs/btrfs/delayed-inode.c:1410 btrfs_assert_delayed_root_empty

2014-12-28 Thread Marc MERLIN
On Mon, Dec 29, 2014 at 01:00:47AM +0500, Roman Mamedov wrote: > > Will btrfs scrub, even if it takes about 24H to run for me, tell me > > which FS is affected and if so do I run btrfs repair? > > I had this: http://www.spinics.net/lists/linux-btrfs/msg40586.html > > 1) I determined which btrfs o

3.16.3: fs/btrfs/delayed-inode.c:1410 btrfs_assert_delayed_root_empty

2014-12-28 Thread Marc MERLIN
Not sure if it's useful to anyone, but there you go. This happened after a forced power cycle: BTRFS info (device dm-1): disk space caching is enabled [ cut here ] WARNING: CPU: 2 PID: 778 at fs/btrfs/delayed-inode.c:1410 btrfs_assert_delayed_root_empty+0x32/0x34() Module

Re: Fixing Btrfs Filesystem Full Problems typo?

2014-12-07 Thread Marc MERLIN
On Sun, Nov 23, 2014 at 07:52:29AM +, Duncan wrote: > > Right. So, why would you rebalance empty chunks or near empty chunks? > > Don't you want to rebalance almost full chunks first, and work you way > > to less and less full as needed? > > No, the closer to empty a chunk is, the more effect

Re: abort device removal?

2014-12-07 Thread Marc MERLIN
On Fri, Dec 05, 2014 at 12:28:57PM -0500, moparisthebest wrote: > Hello all, > > I had a 6-device array I added a 4tb device to last night and ran the > command to remove a previous 4tb device that still worked fine > overnight. Unfortunately, one of the OTHER devices completely failed > while th

Re: Possible to undo subvol delete?

2014-12-01 Thread Marc MERLIN
On Tue, Dec 02, 2014 at 06:33:38AM +0100, MegaBrutal wrote: > 2014-12-01 17:39 GMT+01:00 Shriramana Sharma : > > > > When btrfs has so many features (esp snapshots) to prevent user > > accidentally deleting data (I liked especially > > http://www.youtube.com/v/9H7e6BcI5Fo?start=209) I think there h

Re: Moving an entire subvol?

2014-11-30 Thread Marc MERLIN
On Sun, Nov 30, 2014 at 03:57:06PM +0530, Shriramana Sharma wrote: > On Sun, Nov 30, 2014 at 9:51 AM, Marc MERLIN wrote: > > > >> So the Ubuntu Wiki BtrFS entry advises against using subvol > >> set-default because it boots its kernel using root=subvol=@ and home >

<    1   2   3   4   5   6   7   8   >