Re: [PATCH 1/6] Btrfs: add mount option for dax

On Fri, Dec 09, 2016 at 10:41:34AM -0800, Liu Bo wrote: > On Fri, Dec 09, 2016 at 03:47:20PM +1100, Dave Chinner wrote: > > On Wed, Dec 07, 2016 at 01:45:05PM -0800, Liu Bo wrote: > > > Signed-off-by: Liu Bo > > > --- > > > fs/btrfs/ctree.h | 1 + > > > fs/btrfs/super.c | 40

Re: btrfs_destroy_inode warn (outstanding extents)

On Thu, Dec 01, 2016 at 10:32:09AM -0500, Dave Jones wrote: > > (function-graph screws up the RIP for some reason, 'return_to_handler' > should actually be btrfs_destroy_inode) That's because function_graph hijacks the return address and replaces it with return_to_handler. The back trace has cod

Re: out-of-band dedup status?

On Fri, Dec 9, 2016 at 11:16 AM, Darrick J. Wong wrote: > [adding mark fasheh (duperemove maintainer) to cc] > > On Fri, Dec 09, 2016 at 07:29:21AM -0500, Austin S. Hemmelgarn wrote: >> On 2016-12-08 21:54, Chris Murphy wrote: >> >On Thu, Dec 8, 2016 at 7:26 PM, Darrick J. Wong >> >wrote: >> >>O

Re: [PATCH 1/6] Btrfs: add mount option for dax

On Fri, Dec 09, 2016 at 03:47:20PM +1100, Dave Chinner wrote: > On Wed, Dec 07, 2016 at 01:45:05PM -0800, Liu Bo wrote: > > Signed-off-by: Liu Bo > > --- > > fs/btrfs/ctree.h | 1 + > > fs/btrfs/super.c | 40 +++- > > 2 files changed, 40 insertions(+), 1 delet

Re: [PATCH 4/6] Btrfs: add DAX support for nocow btrfs

On Fri, Dec 09, 2016 at 01:31:03PM +0100, Jan Kara wrote: > On Thu 08-12-16 08:45:39, Liu Bo wrote: > > On Thu, Dec 08, 2016 at 11:47:41AM +0100, Jan Kara wrote: > > > On Wed 07-12-16 17:15:42, Chris Mason wrote: > > > > On 12/07/2016 04:45 PM, Liu Bo wrote: > > > > >This has implemented DAX suppor

Re: out-of-band dedup status?

[adding mark fasheh (duperemove maintainer) to cc] On Fri, Dec 09, 2016 at 07:29:21AM -0500, Austin S. Hemmelgarn wrote: > On 2016-12-08 21:54, Chris Murphy wrote: > >On Thu, Dec 8, 2016 at 7:26 PM, Darrick J. Wong > >wrote: > >>On Thu, Dec 08, 2016 at 05:45:40PM -0700, Chris Murphy wrote: > >>>

[PATCH] duperemove: test presence of dedupe ioctl

Since a zero-length dedupe operation is guaranteed to succeed, use that to test whether or not this filesystem supports dedupe. Signed-off-by: Darrick J. Wong --- file_scan.c | 47 +-- 1 file changed, 37 insertions(+), 10 deletions(-) diff --git a/f

Re: duperemove : some real world figures on BTRFS deduplication

On 12/09/16 16:43, Chris Murphy wrote: >> If compression has nothing to do with this, then this is heavy >> fragmentation. > > It's probably not that fragmented. Due to compression, metadata > describes 128KiB extents even though the data is actually contiguous. > > And it might be the same thing

Re: duperemove : some real world figures on BTRFS deduplication

On Fri, Dec 9, 2016 at 6:45 AM, Swâmi Petaramesh wrote: > Hi Chris, thanks for your answer, > > On 12/09/2016 03:58 AM, Chris Murphy wrote: >> Can you check some bigger files and see if they've become fragmented? >> I'm seeing 1.4GiB files with 2-3 extents reported by filefrag, go to >> over 5000

Re: [PATCH 4/6] Btrfs: add DAX support for nocow btrfs

On 12/09/2016 12:13 AM, Dave Chinner wrote: On Wed, Dec 07, 2016 at 01:45:08PM -0800, Liu Bo wrote: Since I haven't figure out how to map multiple devices to userspace without pagecache, this DAX support is only for single-device, and I don't think DAX(Direct Access) can work with cow, this is

Re: duperemove : some real world figures on BTRFS deduplication

Hi Jeff, thanks for your reply, On 12/08/2016 09:07 PM, Jeff Mahoney wrote: > What version were you using? That's v0.11.beta4, installed rather recently > What throughput are you getting to that disk? I get that it's USB3, but > reading 1TB doesn't take a terribly long time so 15 days is pretty

Re: duperemove : some real world figures on BTRFS deduplication

Hi Chris, thanks for your answer, On 12/09/2016 03:58 AM, Chris Murphy wrote: > Can you check some bigger files and see if they've become fragmented? > I'm seeing 1.4GiB files with 2-3 extents reported by filefrag, go to > over 5000 fragments during dedupe. This is not something I recall > happeni

Re: autoversioning?

On 2016-12-09 06:02, Ulli Horlacher wrote: Is file autoversioning possible with btrfs? I have a VMS background, where the standard filesystem automatically creates a new version for every file that is written. The number of versions can be controlled globally, on directory or on file base. Wit

Re: [PATCH 4/6] Btrfs: add DAX support for nocow btrfs

On Thu 08-12-16 08:45:39, Liu Bo wrote: > On Thu, Dec 08, 2016 at 11:47:41AM +0100, Jan Kara wrote: > > On Wed 07-12-16 17:15:42, Chris Mason wrote: > > > On 12/07/2016 04:45 PM, Liu Bo wrote: > > > >This has implemented DAX support for btrfs with nocow and single-device. > > > > > > > >DAX is deve

Re: out-of-band dedup status?

On 2016-12-08 21:54, Chris Murphy wrote: On Thu, Dec 8, 2016 at 7:26 PM, Darrick J. Wong wrote: On Thu, Dec 08, 2016 at 05:45:40PM -0700, Chris Murphy wrote: OK something's wrong. Kernel 4.8.12 and duperemove v0.11.beta4. Brand new file system (mkfs.btrfs -dsingle -msingle, default mount opti

autoversioning?

Is file autoversioning possible with btrfs? I have a VMS background, where the standard filesystem automatically creates a new version for every file that is written. The number of versions can be controlled globally, on directory or on file base. With btrfs I can create manually a file version

Re: out-of-band dedup status?

On Thu, Dec 08, 2016 at 03:15:38PM -0500, Jeff Mahoney wrote: > On 12/8/16 1:36 PM, Christoph Anton Mitterer wrote: > > I just wondered whether out-of-band/"offline" dedup is safe for general > > use... https://btrfs.wiki.kernel.org/index.php/Status kinda implies so > > (it tells about unspecified

Re: out-of-band dedup status?

On Thu, Dec 08, 2016 at 07:54:39PM -0700, Chris Murphy wrote: > On Thu, Dec 8, 2016 at 7:26 PM, Darrick J. Wong > wrote: > > Ew, it's deduping these two 1.4GB files 128K at a time, which results in > > 12000 ioctl calls. Each of those 12000 calls has to lock the two > > inodes, read the file con