RE: linux 4.7.2 & btrfs & rsync & OOM gone crazy

2016-08-26 Thread Paul Jones
> -Original Message- > From: linux-btrfs-ow...@vger.kernel.org [mailto:linux-btrfs- > ow...@vger.kernel.org] On Behalf Of E V > Sent: Saturday, 27 August 2016 5:01 AM > To: linux-btrfs > Subject: linux 4.7.2 & btrfs & rsync & OOM gone crazy > > Just upgraded from 4.6.5 to 4.7.2 for my bt

Re: [PATCH 0/3] Btrfs: fix free space tree bitmaps+tests on big-endian systems

2016-08-26 Thread Omar Sandoval
On Fri, Aug 26, 2016 at 02:06:29PM +0300, Anatoly Pugachev wrote: > On Thu, Aug 18, 2016 at 11:33 PM, Omar Sandoval wrote: > > On Tue, Jul 19, 2016 at 03:25:16PM -0400, Chris Mason wrote: > >> On 07/19/2016 12:06 PM, Chandan Rajendra wrote: > >> > >> Omar, looks like we need to make the patched ke

[GIT PULL] Btrfs

2016-08-26 Thread Chris Mason
Hi Linus, Please pull my for-linus-4.8 branch: git://git.kernel.org/pub/scm/linux/kernel/git/mason/linux-btrfs.git for-linus-4.8 We've queued up a few different fixes in here. These range from enospc corners to fsync and quota fixes, and a few targeted at error handling for corrupt metadata/fu

fuzzed segv in btrfsck

2016-08-26 Thread Lukas Lueg
Hi, let me draw your attention to https://bugzilla.kernel.org/show_bug.cgi?id=154021 which is a reproducible segv in btrfs-progs v4.7-42-g56e9586 I found while fuzzing btrfs. Best regards Lukas -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to m

Re: Switch raid mode without rebalance?

2016-08-26 Thread Chris Murphy
On Fri, Aug 26, 2016 at 1:18 PM, Gert Menke wrote: > Hi Chris, > > first off, thank you for the detailled explanations! > > On 2016-08-26 01:04, Chris Murphy wrote: >> >> No, it's not a file, directory or subvolume specific command. It >> applies to a whole volume. > > You are right, but all I was

Re: linux 4.7.2 & btrfs & rsync & OOM gone crazy

2016-08-26 Thread E V
Interesting, thanks. Patch doesn't apply clean to 4.7.2, but I get the gist, delete one version of should_compact_retry() and move ifdef so it only has __alloc_pages_direct_compact(). I'll try it out if my rsync gets OOM'd again. On Fri, Aug 26, 2016 at 3:02 PM, Tomasz Torcz wrote: > On Fri, Aug

Re: Switch raid mode without rebalance?

2016-08-26 Thread Gert Menke
Hi, On 2016-08-26 13:52, Austin S. Hemmelgarn wrote: Regular 'df' isn't to be trusted when dealing with BTRFS, the only reason we report anything there is because many things break horribly if we don't. Yeah, I noticed. Seems to produce a reasonable guess, though. Additionally, while running

heap-use-after-free in btrfsck v4.7-42-g56e9586

2016-08-26 Thread Lukas Lueg
Hi, let me draw your attention to https://bugzilla.kernel.org/show_bug.cgi?id=153641 which is a heap-use-after-free bug in btrfs-progs v4.7-42-g56e9586 I found while fuzzing btrfs. There are more bugs like this. How do you people want them to be reported? Best regards Lukas -- To unsubscribe fro

Re: Switch raid mode without rebalance?

2016-08-26 Thread Gert Menke
Hi Chris, first off, thank you for the detailled explanations! On 2016-08-26 01:04, Chris Murphy wrote: No, it's not a file, directory or subvolume specific command. It applies to a whole volume. You are right, but all I was after in the first place was a way to change the mode for new data on

Re: linux 4.7.2 & btrfs & rsync & OOM gone crazy

2016-08-26 Thread Tomasz Torcz
On Fri, Aug 26, 2016 at 03:00:48PM -0400, E V wrote: > Just upgraded from 4.6.5 to 4.7.2 for my btrfs backup server with 32GB > of ram. Only thing that run's on it is an rsync of an NFS filesystem > to the local btrfs. Cached mem tends to hang out around 26-30GB, but > with 4.7.2 the OOM is now goi

linux 4.7.2 & btrfs & rsync & OOM gone crazy

2016-08-26 Thread E V
Just upgraded from 4.6.5 to 4.7.2 for my btrfs backup server with 32GB of ram. Only thing that run's on it is an rsync of an NFS filesystem to the local btrfs. Cached mem tends to hang out around 26-30GB, but with 4.7.2 the OOM is now going crazy and trying to kill whatever it can including my ssh

Re: Btrfs progs release 4.7.1

2016-08-26 Thread Luis Henriques
David Sterba writes: > On Fri, Aug 26, 2016 at 12:24:10AM +0100, Luis Henriques wrote: >> On Thu, Aug 25, 2016 at 07:47:27PM +0200, David Sterba wrote: >> > Hi, >> > >> > btrfs-progs 4.7 have been released. Though it's a minor version release, >> > there >> > are changes that could be considere

Re: Switch raid mode without rebalance?

2016-08-26 Thread Austin S. Hemmelgarn
On 2016-08-25 18:32, Gert Menke wrote: Hi, On 2016-08-25 20:26, Justin Kilpatrick wrote: I'm not sure why you want to avoid a balance, I didn't check, but I imagined it would slow down my rsync significantly. It will slow it down, but I can't tell you exactly how much (there are too many var

Re: [PATCH 0/3] Btrfs: fix free space tree bitmaps+tests on big-endian systems

2016-08-26 Thread Anatoly Pugachev
On Thu, Aug 18, 2016 at 11:33 PM, Omar Sandoval wrote: > On Tue, Jul 19, 2016 at 03:25:16PM -0400, Chris Mason wrote: >> On 07/19/2016 12:06 PM, Chandan Rajendra wrote: >> >> Omar, looks like we need to make the patched kernel refuse to mount free >> space trees without a new incompat bit set. Th

Re: Btrfs progs release 4.7.1

2016-08-26 Thread David Sterba
On Fri, Aug 26, 2016 at 12:24:10AM +0100, Luis Henriques wrote: > On Thu, Aug 25, 2016 at 07:47:27PM +0200, David Sterba wrote: > > Hi, > > > > btrfs-progs 4.7 have been released. Though it's a minor version release, > > there > > are changes that could be considered big but I don't see a reason