Re: Btrfs disk layout question

2017-04-14 Thread Andrei Borzenkov
12.04.2017 20:21, Chris Murphy пишет: > btrfs-map-logical is the tool that will convert logical to physical > and also give what device it's on; but the device notation is copy 1 > and copy 2, so you have to infer what device that is, it's not > explicit. > Actually I just checked with btrfsprogs

Re: Encountered kernel bug#72811. Advice on recovery?

2017-04-14 Thread Duncan
ronnie sahlberg posted on Fri, 14 Apr 2017 09:56:30 -0700 as excerpted: > On Thu, Apr 13, 2017 at 8:47 PM, Duncan <1i5t5.dun...@cox.net> wrote: >> Ank Ular posted on Thu, 13 Apr 2017 14:49:41 -0400 as excerpted: > ... >> OK, I'm one of the ones that's going to "go off" on you, but FWIW, I >> expec

Re: Remounting read-write after error is not allowed

2017-04-14 Thread Alexandru Guzu
Thanks for the reply. I mounted it ro: $ sudo btrfs fi show /mnt Segmentation fault (core dumped) dmesg says: ... kernel BUG at /build/linux-wXdoVv/linux-4.4.0/fs/btrfs/ctree.c:5205! ... RIP: 0010:[] [] btrfs_search_forward+0x268/0x350 [btrfs] ... Call Trace: [] search_ioctl+0xf2/0x1

[4.9] btrfs check --repair looping over file extent discount errors

2017-04-14 Thread Martin Steigerwald
Hello, backup harddisk connected via eSATA. Hard kernel hang, mouse pointer freezing two times seemingly after finishing /home backup and creating new snapshot on source BTRFS SSD RAID 1 for / in order to backup it. I did scrubbed / and it appears to be okay, but I didn´t run btrfs check on it.

[GIT PULL] Btrfs

2017-04-14 Thread Chris Mason
Hi Linus Dave Sterba collected a few more fixes for the last rc: git://git.kernel.org/pub/scm/linux/kernel/git/mason/linux-btrfs.git for-linus-4.11 These aren't marked for stable, but I'm putting them in with a batch were testing/sending by hand for this release. Liu Bo (3) commits (+11/-13

Re: Remounting read-write after error is not allowed

2017-04-14 Thread Chris Murphy
Can you ro mount it and: btrfs fi show /mnt btrfs fi df /mnt And then next update the btrfs-progs to something newer like 4.9.2 or 4.10.2 and then do another 'btrfs check' without repair. And then separately do it again with --mode=lowmem and post both sets of results? Chris Murphy -- To unsubs

Re: Encountered kernel bug#72811. Advice on recovery?

2017-04-14 Thread Chris Murphy
On Fri, Apr 14, 2017 at 10:46 AM, Chris Murphy wrote: > > The passive repair works when it's a few bad sectors on the drive. But > when it's piles of missing data, this is the wrong mode. It needs a > limited scrub or balance to fix things. Right now you have to manually > do a full scrub or bala

Re: Encountered kernel bug#72811. Advice on recovery?

2017-04-14 Thread ronnie sahlberg
On Thu, Apr 13, 2017 at 8:47 PM, Duncan <1i5t5.dun...@cox.net> wrote: > Ank Ular posted on Thu, 13 Apr 2017 14:49:41 -0400 as excerpted: ... > OK, I'm one of the ones that's going to "go off" on you, but FWIW, I > expect pretty much everyone else would pretty much agree. At least you > do have bac

Re: Encountered kernel bug#72811. Advice on recovery?

2017-04-14 Thread Chris Murphy
Summary: 22x device raid6 (data and metadata). One device vanished, and the volume is rw,degraded mounted with writes happening; next time it's mounted the formerly missing device is not missing so it's a normal mount, and writes are happening. Then later, the filesystem goes read only. Now there a

Re: btrfs send extremely slow (almost stuck)

2017-04-14 Thread J. Hart
on 30.08.2016 at 02:48 Qu Wenruo wrote : > Not the first, but although still few. > There is a xfstest case submitted for it, and even before the test case, there are already report from IRC. > Anyway, I'll add Cc for you after the new IRC patch is out. Please count me in. I have this occur wh

[PATCH 7/8] nowait aio: xfs

2017-04-14 Thread Goldwyn Rodrigues
From: Goldwyn Rodrigues If IOCB_NOWAIT is set, bail if the i_rwsem is not lockable immediately. IF IOMAP_NOWAIT is set, return EAGAIN in xfs_file_iomap_begin if it needs allocation either due to file extension, writing to a hole, or COW or waiting for other DIOs to finish. Signed-off-by: Goldwy

[PATCH 3/8] nowait aio: return if direct write will trigger writeback

2017-04-14 Thread Goldwyn Rodrigues
From: Goldwyn Rodrigues Find out if the write will trigger a wait due to writeback. If yes, return -EAGAIN. This introduces a new function filemap_range_has_page() which returns true if the file's mapping has a page within the range mentioned. Return -EINVAL for buffered AIO: there are multiple

[PATCH 5/8] nowait aio: return on congested block device

2017-04-14 Thread Goldwyn Rodrigues
From: Goldwyn Rodrigues A new bio operation flag REQ_NOWAIT is introduced to identify bio's orignating from iocb with IOCB_NOWAIT. This flag indicates to return immediately if a request cannot be made instead of retrying. To facilitate this, QUEUE_FLAG_NOWAIT is set to devices which support this

[PATCH 6/8] nowait aio: ext4

2017-04-14 Thread Goldwyn Rodrigues
From: Goldwyn Rodrigues Return EAGAIN if any of the following checks fail for direct I/O: + i_rwsem is lockable + Writing beyond end of file (will trigger allocation) + Blocks are not allocated at the write location Signed-off-by: Goldwyn Rodrigues --- fs/ext4/file.c | 20 +++

[PATCH 4/8] nowait-aio: Introduce IOMAP_NOWAIT

2017-04-14 Thread Goldwyn Rodrigues
From: Goldwyn Rodrigues IOCB_NOWAIT translates to IOMAP_NOWAIT for iomaps. This is used by XFS in the XFS patch. --- fs/iomap.c| 2 ++ include/linux/iomap.h | 1 + 2 files changed, 3 insertions(+) diff --git a/fs/iomap.c b/fs/iomap.c index 141c3cd55a8b..d1c81753d411 100644 --- a/fs/

[PATCH 8/8] nowait aio: btrfs

2017-04-14 Thread Goldwyn Rodrigues
From: Goldwyn Rodrigues Return EAGAIN if any of the following checks fail + i_rwsem is not lockable + NODATACOW or PREALLOC is not set + Cannot nocow at the desired location + Writing beyond end of file which is not allocated Signed-off-by: Goldwyn Rodrigues --- fs/btrfs/file.c | 25 +

[PATCH 2/8] nowait aio: Introduce RWF_NOWAIT

2017-04-14 Thread Goldwyn Rodrigues
From: Goldwyn Rodrigues This flag informs kernel to bail out if an AIO request will block for reasons such as file allocations, or a writeback triggered, or would block while allocating requests while performing direct I/O. Unfortunately, aio_flags is not checked for validity, which would break

[PATCH 1/8] Use RWF_* flags for AIO operations

2017-04-14 Thread Goldwyn Rodrigues
From: Goldwyn Rodrigues RWF_* flags is used for preadv2/pwritev2 calls. Port to use it for aio operations as well. For this, aio_rw_flags is introduced in struct iocb (using aio_reserved1) which will carry these flags. This is a precursor to the nowait AIO calls. Note, the only place RWF_HIPRI

[PATCH 0/8 v6] No wait AIO

2017-04-14 Thread Goldwyn Rodrigues
Formerly known as non-blocking AIO. This series adds nonblocking feature to asynchronous I/O writes. io_submit() can be delayed because of a number of reason: - Block allocation for files - Data writebacks for direct I/O - Sleeping because of waiting to acquire i_rwsem - Congested block device

Intel XPoint Tech / Optane SSDs

2017-04-14 Thread Imran Geriskovan
Well, this may the follow up for the Btrfs/SSD discussion. Probably nobody here had his hands on these Optane SSDs (or is it?) Anyway, what are your expectations/projections about memory/storage hybrid tech? XPoint and/or any other tech will make memory and storage eventually to converge. With

Btrfs/SSD

2017-04-14 Thread Imran Geriskovan
Hi, Sometime ago we had some discussion about SSDs. Within the limits of unknown/undocumented device infos, we loosely had covered data retension capability/disk age/life time interrelations, (in?)effectiveness of btrfs dup on SSDs, etc.. Now, as time passed and with some accumulated experience on