Re: btrfs check --repair couldn't solve problem with btrfs partition

2014-11-13 Thread Qu Wenruo
Hi! Several times I try repair my btrfs partition with follow commands: [root@localhost ~]# umount /home root@localhost ~]# btrfs check --repair /dev/sdb1 enabling repair mode Fixed 0 roots. Checking filesystem on /dev/sdb1 UUID: 82df2d84-bf54-46cb-84ba-c88e93677948 checking extents checking

Re: BTRFS Raid5/6 Recovery Problem after accidentially hibernation

2014-11-13 Thread Duncan
Juergen Sauer posted on Wed, 12 Nov 2014 18:26:56 +0100 as excerpted: Current Status: # root@pc6:~# btrfs fi show /dev/sda1 # parent transid verify failed on 209362944 wanted 293924 found 293922 # parent transid verify failed on 209362944 wanted 293924 found 293922 What does parent transid

About leaf corruption recovery(currently only fs/subvol tree recovery)

2014-11-13 Thread Qu Wenruo
Hi all, I'm trying to implement leaf corruption recovery. *CURRENT BEHAVIOR* Btrfs now heavily rely on chunk level duplication to protect its tree block(meta data). That's completely good and works quite well. However small device with mixed single chunk will suffer from the lack of

Re: Quota question

2014-11-13 Thread Dongsheng Yang
On 11/13/2014 11:05 AM, Dongsheng Yang wrote: On 11/12/2014 10:04 PM, Cyril Scetbon wrote: Anyone on this ? There is an issue with quotas depending on the write rate. The more we can write before a sync, the more we can exceed quotas limits Hi Cyril, I attempted to reproduce the problem you

[PATCH v7] Move BTRFS RCU string to common library

2014-11-13 Thread Omar Sandoval
The RCU-friendly string API used internally by BTRFS is generic enough for common use. This doesn't add any new functionality, but instead just moves the code and documents the existing API. Reviewed-by: Josh Triplett j...@joshtriplett.org Acked-by: Paul E. McKenney paul...@linux.vnet.ibm.com

Re: btrfs balance fails with no space errors (despite having plenty)

2014-11-13 Thread Hugo Mills
On Wed, Nov 12, 2014 at 06:48:47PM +, Kline, Matthew wrote: Yesterday I converted my ext4 root and home partitions on my home machine to btrfs using btrfs-convert. After confirming that everything went well, I followed the wiki instructions to nuke the 'ext2_saved subvolume, then defraggad

Re: Quota question

2014-11-13 Thread Cyril Scetbon
Hey, I'm using ubuntu kernels provided at http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.17.1-utopic/. I asked them how to rebuild one with a patch and will try it when I got the answer. Thanks PS : good news and I hope it'll fix the issue -- Cyril SCETBON On 13 Nov 2014, at 10:40,

soft lockup - CPU#0 stuck - Kernel 3.17.2

2014-11-13 Thread Patrick Schmid
Hi all, we run a 500 TiB backup system on iSCSI targets using 19 BTRFS filesystems (the biggest of which is 110 TiB) on Ubuntu 14.04 LTS and various kernel versions. Btrfs-Progs v3.17.1. The hardware is a 24 core Xeon E5-2620 on an Intel S2600GZ board with 128 GiB RAM. Since btrfs has changed

Re: About leaf corruption recovery(currently only fs/subvol tree recovery)

2014-11-13 Thread Josef Bacik
On 11/13/2014 04:02 AM, Qu Wenruo wrote: Hi all, I'm trying to implement leaf corruption recovery. *CURRENT BEHAVIOR* Btrfs now heavily rely on chunk level duplication to protect its tree block(meta data). That's completely good and works quite well. However small device with mixed single

Re: soft lockup - CPU#0 stuck - Kernel 3.17.2

2014-11-13 Thread Chris Mason
On Thu, Nov 13, 2014 at 8:32 AM, Patrick Schmid sch...@phys.ethz.ch wrote: Hi all, we run a 500 TiB backup system on iSCSI targets using 19 BTRFS filesystems (the biggest of which is 110 TiB) on Ubuntu 14.04 LTS and various kernel versions. Btrfs-Progs v3.17.1. The hardware is a 24 core

Re: [PATCH v2] fstests: btrfs, add test for snapshoting after file write + truncate

2014-11-13 Thread Josef Bacik
On 10/26/2014 07:39 AM, Filipe Manana wrote: Regression test for a btrfs issue where if right after the snapshot creation ioctl started, a file write followed by a file truncate happened, with both operations increasing the file's size, the created snapshot would capture an inconsistent state of

Re: [PATCH v2] fstests: btrfs, add regression test for clone ioctl

2014-11-13 Thread Josef Bacik
On 11/10/2014 06:42 AM, Filipe Manana wrote: Regression test for a btrfs clone ioctl issue where races between a clone operation and concurrent target file reads would result in leaving stale data in the page cache. After the clone operation finished, reading from the clone target file would

[PATCH] Btrfs: don't ignore log btree writeback errors

2014-11-13 Thread Filipe Manana
If an error happens during writeback of log btree extents, make sure the error is returned to the caller (fsync), so that it takes proper action (commit current transaction) instead of writing a superblock that points to log btrees with all or some nodes that weren't durably persisted.

[PATCH] Btrfs: collect only the necessary ordered extents on ranged fsync

2014-11-13 Thread Filipe Manana
Instead of collecting all ordered extents from the inode's ordered tree and then wait for all of them to complete, just collect the ones that overlap the fsync range. Signed-off-by: Filipe Manana fdman...@suse.com --- fs/btrfs/ordered-data.c | 16 +--- fs/btrfs/ordered-data.h | 4

[PATCH] Btrfs: ensure ordered extent errors aren't missed on fsync

2014-11-13 Thread Filipe Manana
When doing a fsync with a fast path we have a time window where we can miss the fact that writeback of some file data failed, and therefore we endup returning success (0) from fsync when we should return an error. The steps that lead to this are the following: 1) We start all ordered extents by

Re: [PATCH] Btrfs: don't ignore log btree writeback errors

2014-11-13 Thread Holger Hoffstätte
On Thu, 13 Nov 2014 16:59:53 +, Filipe Manana wrote: If an error happens during writeback of log btree extents, make sure the error is returned to the caller (fsync), so that it takes proper action (commit current transaction) instead of writing a superblock that points to log btrees with

Re: [PATCH] Btrfs: don't ignore log btree writeback errors

2014-11-13 Thread Holger Hoffstätte
On Thu, 13 Nov 2014 17:33:19 +, Holger Hoffstätte wrote: On Thu, 13 Nov 2014 16:59:53 +, Filipe Manana wrote: If an error happens during writeback of log btree extents, make sure the error is returned to the caller (fsync), so that it takes proper action (commit current transaction)

Re: [PATCH] Btrfs: don't ignore log btree writeback errors

2014-11-13 Thread Filipe David Manana
On Thu, Nov 13, 2014 at 5:33 PM, Holger Hoffstätte holger.hoffstae...@googlemail.com wrote: On Thu, 13 Nov 2014 16:59:53 +, Filipe Manana wrote: If an error happens during writeback of log btree extents, make sure the error is returned to the caller (fsync), so that it takes proper action

Re: [PATCH] Btrfs: don't ignore log btree writeback errors

2014-11-13 Thread Filipe David Manana
On Thu, Nov 13, 2014 at 5:43 PM, Holger Hoffstätte holger.hoffstae...@googlemail.com wrote: On Thu, 13 Nov 2014 17:33:19 +, Holger Hoffstätte wrote: On Thu, 13 Nov 2014 16:59:53 +, Filipe Manana wrote: If an error happens during writeback of log btree extents, make sure the error is

Re: [PATCH] Btrfs: don't ignore log btree writeback errors

2014-11-13 Thread Holger Hoffstätte
On Thu, 13 Nov 2014 17:50:44 +, Filipe David Manana wrote: [snip] This first hunk didn't apply to my 3.14.x tree that is 99.999% in sync with btrfs-3.18+, as a line is missing from the context. See:

Re: [PATCH] Btrfs: don't ignore log btree writeback errors

2014-11-13 Thread Holger Hoffstätte
On Thu, 13 Nov 2014 17:47:51 +, Filipe David Manana wrote: [snip] While Chris' integration/for-linus branches don't have the patch included yet (nor do I in my local branch). Nevertheless, it's a trivial conflict to solve, just leave Josef's changes and mine. So if I read this correctly

Re: soft lockup - CPU#0 stuck - Kernel 3.17.2

2014-11-13 Thread Patrick Schmid
On 11/13/2014 03:49 PM, Chris Mason wrote: On Thu, Nov 13, 2014 at 8:32 AM, Patrick Schmid sch...@phys.ethz.ch wrote: Hi all, we run a 500 TiB backup system on iSCSI targets using 19 BTRFS filesystems (the biggest of which is 110 TiB) on Ubuntu 14.04 LTS and various kernel versions.

Re: soft lockup - CPU#0 stuck - Kernel 3.17.2

2014-11-13 Thread Chris Mason
On Thu, Nov 13, 2014 at 2:07 PM, Patrick Schmid sch...@phys.ethz.ch wrote: On 11/13/2014 03:49 PM, Chris Mason wrote: On Thu, Nov 13, 2014 at 8:32 AM, Patrick Schmid sch...@phys.ethz.ch wrote: Hi all, we run a 500 TiB backup system on iSCSI targets using 19 BTRFS filesystems (the

[PATCH 12/56] fs/btrfs: support compiling out splice

2014-11-13 Thread Pieter Smith
Compile out splice support from btrfs when the splice-family of syscalls is not supported by the system (i.e. CONFIG_SYSCALL_SPLICE is undefined). Signed-off-by: Pieter Smith pie...@boesman.nl --- fs/btrfs/file.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/fs/btrfs/file.c

Re: [PATCH] btrfs: Don't check for file-private_data on open(). It is set by the core.

2014-11-13 Thread Al Viro
On Wed, Nov 12, 2014 at 07:34:50PM +0100, Martin Kepplinger wrote: Btrfs uses this in the transaction start ioctl to record the transaction handle being started. Ceph is the main user of the ioctl, and we could setup a hash table if needed. But which call path in miscdevice is doing

Re: About leaf corruption recovery(currently only fs/subvol tree recovery)

2014-11-13 Thread Qu Wenruo
Original Message Subject: Re: About leaf corruption recovery(currently only fs/subvol tree recovery) From: Josef Bacik jba...@fb.com To: Qu Wenruo quwen...@cn.fujitsu.com, linux-btrfs linux-btrfs@vger.kernel.org Date: 2014年11月13日 22:43 On 11/13/2014 04:02 AM, Qu Wenruo