Re: deadlock with btrfs heavy i/o and kswapd

2016-09-26 Thread Stefan Priebe - Profihost AG
Am 22.09.2016 um 16:28 schrieb Chris Mason: > > > On 09/22/2016 02:41 AM, Stefan Priebe - Profihost AG wrote: >> Hi, >> >> i always encounter btrfs deadlocks / hung tasks, when i have a lot of >> cached mem and i'm doing heavy rsync --inplace operations in my system >> from btrfs zlib compressed

Re: State of the fuzzer

2016-09-26 Thread Lukas Lueg
Hi David, do we have any chance of engagement on those 23 bugs which came out of the last fuzzing round? The nodes have been basically idle for a week, spewing duplicates and variants of what's already known... Best regards Lukas 2016-09-20 13:33 GMT+02:00 Lukas Lueg : > There are now 21 bugs op

btrfs on md RAID-5 /etc/fstab mounting: open_ctree failed

2016-09-26 Thread Tomasz Chmielewski
My btrfs on md RAID-5 mounts in an odd way and fails to mount via /etc/fstab (kernel is 4.8-rc8). This is /etc/fstab entry for btrfs: /dev/md2 /data btrfs noatime,compress-force=zlib,device=/dev/md2 0 0 Following a system restart, it didn't mount with these in dmesg: [ 11.099524] Btrfs loa

Re: Does data checksumming remain for files with No_COW file attribute?

2016-09-26 Thread Austin S. Hemmelgarn
On 2016-09-24 14:11, Christoph Anton Mitterer wrote: On Sat, 2016-09-24 at 12:43 +, Hugo Mills wrote: It's because you can't update the data and the checksum atomically -- at some point in the writing process, they must be inconsistent. This is considered a Bad Thing. It's not worse at

send -p stuck with kernel bug message

2016-09-26 Thread Romulo
Hi, I faced a problem with send -p command, that occur with an specif snapshot and any parent before it, I isolated the problem being in send as it occur even in a "send -p> /dev/null". I've tried "-vvv" with no extra information success. Send work fine for any of the two snaps. I've dedup

Re: [PATCH] qgroup: Prevent qgroup->reserved from going subzero

2016-09-26 Thread Goldwyn Rodrigues
On 09/25/2016 09:33 PM, Qu Wenruo wrote: > > > At 09/23/2016 09:43 PM, Goldwyn Rodrigues wrote: >> >> >> On 09/22/2016 08:06 PM, Qu Wenruo wrote: >>> >>> >>> At 09/23/2016 02:47 AM, Goldwyn Rodrigues wrote: From: Goldwyn Rodrigues While free'ing qgroup->reserved resources, we mu

Re: [PATCH v2 6/6] Btrfs: use less memory for delalloc sanity tests

2016-09-26 Thread David Sterba
On Fri, Sep 23, 2016 at 02:22:53PM -0700, Omar Sandoval wrote: > On Fri, Sep 23, 2016 at 09:52:01AM -0700, Omar Sandoval wrote: > > On Fri, Sep 23, 2016 at 11:27:27AM +0200, David Sterba wrote: > > > On Thu, Sep 22, 2016 at 05:24:25PM -0700, Omar Sandoval wrote: > > > > From: Omar Sandoval > > > >

Re: send -p stuck with kernel bug message

2016-09-26 Thread Filipe Manana
On Mon, Sep 26, 2016 at 3:16 PM, Romulo wrote: > Hi, > > I faced a problem with send -p command, that occur with an specif > snapshot and any parent before it, I isolated the problem being in > send as it occur even in a "send -p> /dev/null". I've tried "-vvv" > with no extra information succe

Re: [PATCH] Btrfs: memset to avoid stale content in btree leaf

2016-09-26 Thread David Sterba
On Fri, Sep 23, 2016 at 01:44:44PM -0700, Liu Bo wrote: > @@ -3732,15 +3734,21 @@ static noinline_for_stack int write_one_eb(struct > extent_buffer *eb, > if (btrfs_header_owner(eb) == BTRFS_TREE_LOG_OBJECTID) > bio_flags = EXTENT_BIO_TREE_LOG; > > - /* set btree node bey

Re: [PATCH] btrfs: fix btrfs_no_printk stub helper

2016-09-26 Thread David Sterba
On Fri, Sep 23, 2016 at 06:05:21PM +0200, Arnd Bergmann wrote: > The addition of btrfs_no_printk() caused a build failure when > CONFIG_PRINTK is disabled: > > fs/btrfs/send.c: In function 'send_rename': > fs/btrfs/ctree.h:3367:2: error: implicit declaration of function > 'btrfs_no_printk' [-Werr

Re: [PATCH v2 6/6] Btrfs: use less memory for delalloc sanity tests

2016-09-26 Thread Omar Sandoval
On Mon, Sep 26, 2016 at 05:58:02PM +0200, David Sterba wrote: > On Fri, Sep 23, 2016 at 02:22:53PM -0700, Omar Sandoval wrote: > > On Fri, Sep 23, 2016 at 09:52:01AM -0700, Omar Sandoval wrote: > > > On Fri, Sep 23, 2016 at 11:27:27AM +0200, David Sterba wrote: > > > > On Thu, Sep 22, 2016 at 05:24

Re: [PATCH v2 3/6] Btrfs: catch invalid free space trees

2016-09-26 Thread Omar Sandoval
On Sat, Sep 24, 2016 at 09:50:53PM +0200, Hans van Kranenburg wrote: > On 09/23/2016 02:24 AM, Omar Sandoval wrote: > > From: Omar Sandoval > > > > There are two separate issues that can lead to corrupted free space > > trees. > > > > 1. The free space tree bitmaps had an endianness issue on big

Re: [PATCH v2 3/6] Btrfs: catch invalid free space trees

2016-09-26 Thread Hans van Kranenburg
On 09/26/2016 07:39 PM, Omar Sandoval wrote: > On Sat, Sep 24, 2016 at 09:50:53PM +0200, Hans van Kranenburg wrote: >> On 09/23/2016 02:24 AM, Omar Sandoval wrote: >>> From: Omar Sandoval >>> >>> There are two separate issues that can lead to corrupted free space >>> trees. >>> >>> 1. The free spa

Re: [PATCH v2 0/6] Btrfs: free space tree and sanity test fixes

2016-09-26 Thread Omar Sandoval
Hey, Anatoly, On Sun, Sep 25, 2016 at 10:55:24AM +0300, Anatoly Pugachev wrote: > On Thu, Sep 22, 2016 at 05:22:31PM -0700, Omar Sandoval wrote: > > From: Omar Sandoval > > > > This is v2 of my earlier series "Btrfs: fix free space tree > > bitmaps+tests on big-endian systems" [1]. Patches 1, 4,

Re: [PATCH v2 0/6] Btrfs: free space tree and sanity test fixes

2016-09-26 Thread David Sterba
On Sun, Sep 25, 2016 at 10:55:24AM +0300, Anatoly Pugachev wrote: > applied patch to git kernel (v4.8-rc7-172-gbd5dbcb) cleanly. Did not used > btrfs-progs.git, but debian shipped 4.7.3-1 . > > (re)booted to a newly patched kernel and used xfstests.git > (v1.1.0-1328-g06d4001): > > # mount tmpfs

Re: [PATCH v2 3/6] Btrfs: catch invalid free space trees

2016-09-26 Thread Omar Sandoval
On Mon, Sep 26, 2016 at 07:46:02PM +0200, Hans van Kranenburg wrote: > On 09/26/2016 07:39 PM, Omar Sandoval wrote: > > On Sat, Sep 24, 2016 at 09:50:53PM +0200, Hans van Kranenburg wrote: > >> On 09/23/2016 02:24 AM, Omar Sandoval wrote: > >>> From: Omar Sandoval > >>> > >>> There are two separat

Re: [PATCH v2 0/6] Btrfs: free space tree and sanity test fixes

2016-09-26 Thread Omar Sandoval
On Mon, Sep 26, 2016 at 07:50:00PM +0200, David Sterba wrote: > On Sun, Sep 25, 2016 at 10:55:24AM +0300, Anatoly Pugachev wrote: > > applied patch to git kernel (v4.8-rc7-172-gbd5dbcb) cleanly. Did not used > > btrfs-progs.git, but debian shipped 4.7.3-1 . > > > > (re)booted to a newly patched ke

Re: [PATCH] btrfs-progs: docs: document exit codes from scrub

2016-09-26 Thread David Sterba
On Fri, Sep 23, 2016 at 11:51:57PM +0200, Adam Borowski wrote: > Signed-off-by: Adam Borowski Applied, thanks. -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-i

Re: [PATCH] Btrfs: memset to avoid stale content in btree leaf

2016-09-26 Thread Liu Bo
On Mon, Sep 26, 2016 at 06:54:44PM +0200, David Sterba wrote: > On Fri, Sep 23, 2016 at 01:44:44PM -0700, Liu Bo wrote: > > @@ -3732,15 +3734,21 @@ static noinline_for_stack int write_one_eb(struct > > extent_buffer *eb, > > if (btrfs_header_owner(eb) == BTRFS_TREE_LOG_OBJECTID) > >

Re: [PATCH] btrfs-progs: fix user-facing typos (affects 4.7.3 and devel)

2016-09-26 Thread Nicholas D Steeves
On Sat, Sep 24, 2016 at 09:26:40PM -0400, Nicholas D Steeves wrote: > Hi, > > I found these with lintian (analysis tool for Debian packages) this > evening, and hope this patch is well received :-) The only bit I'm > unsure about is the deletion of what looks like extra whitespace on > the last c

Fwd: OS X Time Machine and BTRFS

2016-09-26 Thread Ruben Salzgeber
Hi everyone I'm reaching out to you because I experience unusually slow read and write speeds on my Arch Linux server in combination with OS X time machine. My setup is consists of an Core i3 6300, 16GB Ram, 128GB SSD for the OS and a 8 drive RAID5 BTRFS volume as archive. The latest version of Av

Re: Does data checksumming remain for files with No_COW file attribute?

2016-09-26 Thread Adam Borowski
On Sun, Sep 25, 2016 at 05:44:30AM +, Duncan wrote: > Adam Borowski posted on Sun, 25 Sep 2016 01:50:14 +0200 as excerpted: > > Actually, it disables pretty much all btrfs features except for... CoW. > > > > You lose: > > * checksums > > * compression > > * safety against power loss (torn writ

Re: Fwd: OS X Time Machine and BTRFS

2016-09-26 Thread Sean Greenslade
On Mon, Sep 26, 2016 at 10:15:11PM +0200, Ruben Salzgeber wrote: > Hi everyone > > I'm reaching out to you because I experience unusually slow read and > write speeds on my Arch Linux server in combination with OS X time > machine. My setup is consists of an Core i3 6300, 16GB Ram, 128GB SSD > for

Re: OS X Time Machine and BTRFS

2016-09-26 Thread Chris Murphy
On Mon, Sep 26, 2016 at 2:15 PM, Ruben Salzgeber wrote: > Hi everyone > > I'm reaching out to you because I experience unusually slow read and > write speeds on my Arch Linux server in combination with OS X time > machine. My setup is consists of an Core i3 6300, 16GB Ram, 128GB SSD > for the OS a

Re: [PATCH] Fix user-facing typos

2016-09-26 Thread David Sterba
On Sat, Sep 24, 2016 at 09:26:41PM -0400, Nicholas D Steeves wrote: > Signed-off-by: Nicholas D Steeves Applied, thanks. -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/m

Re: Fwd: OS X Time Machine and BTRFS

2016-09-26 Thread Chris Murphy
On Mon, Sep 26, 2016 at 2:56 PM, Sean Greenslade wrote: > On Mon, Sep 26, 2016 at 10:15:11PM +0200, Ruben Salzgeber wrote: >> Hi everyone >> >> I'm reaching out to you because I experience unusually slow read and >> write speeds on my Arch Linux server in combination with OS X time >> machine. My

Re: [PATCH v2 3/6] Btrfs: catch invalid free space trees

2016-09-26 Thread Omar Sandoval
On Thu, Sep 22, 2016 at 05:24:22PM -0700, Omar Sandoval wrote: > From: Omar Sandoval > > There are two separate issues that can lead to corrupted free space > trees. > > 1. The free space tree bitmaps had an endianness issue on big-endian >systems which is fixed by an earlier patch in this s

Re: send -p stuck with kernel bug message

2016-09-26 Thread Romulo
As it depends on a commit only landed in 4.8, is there something I can do myself so I can go on with my system snapshot history? Discard all previous Snapshots, stop using the ones I have as references? or there exist another thing I can do about it? I have not balanced my FS anytime as it is a sin

io_submit/read return value

2016-09-26 Thread Nate Hardt
Hello, I am doing some testing on the btrfs shipped with RHEL 7.2 and have a few questions. 1) It appears if I read from a hole in a file, or read a hole in a partially allocated file, the return value for the read is the amount of data actually read from disk, not the amount of data that is writt

Re: OS X Time Machine and BTRFS

2016-09-26 Thread Roman Mamedov
On Mon, 26 Sep 2016 15:06:39 -0600 Chris Murphy wrote: > First question is if the directory containing the sparsebundle file > has xattr +C set on it? It's not xattr, but chattr. "xattr" manages "extended attributes", i.e. arbitrary name=value pairs you can set on a file or directory. But +C is

Re: OS X Time Machine and BTRFS

2016-09-26 Thread Chris Murphy
On Mon, Sep 26, 2016 at 8:16 PM, Roman Mamedov wrote: > On Mon, 26 Sep 2016 15:06:39 -0600 > Chris Murphy wrote: > >> First question is if the directory containing the sparsebundle file >> has xattr +C set on it? > > It's not xattr, but chattr. "xattr" manages "extended attributes", i.e. > arbitr

Re: [PATCH] qgroup: Prevent qgroup->reserved from going subzero

2016-09-26 Thread Qu Wenruo
At 09/26/2016 10:31 PM, Goldwyn Rodrigues wrote: On 09/25/2016 09:33 PM, Qu Wenruo wrote: At 09/23/2016 09:43 PM, Goldwyn Rodrigues wrote: [snipped] Sorry I still don't get the point. Would you please give a call flow of the timing dirtying page and calling btrfs_qgroup_reserve/free/

Re: how to understand "btrfs fi show" output? "No space left" issues

2016-09-26 Thread Tomasz Chmielewski
On 2016-09-21 11:51, Chris Murphy wrote: So if it happens again, first capture the above two bits of information, and then if you feel like testing kernel 4.8rc7 do that. It has a massive pile of enoscp related rework and I bet Josef would like to know if the problem reproduces with that kerne

Re: deadlock with btrfs heavy i/o and kswapd

2016-09-26 Thread Stefan Priebe - Profihost AG
Hi Chris, today i had this again. But i can't see any stack traces. I just see. INFO: kworker/u128:5:24301 blocked for more than 120 seconds. ... INFO: kworker/u128:5:24301 blocked for more than 120 seconds. ... INFO: task mysqld:929 blocked for more ... ... sysrq w just prints: sysrq: SysRq: Sh