Re: btrfs dedup - available or experimental? Or yet to be?

2015-03-29 Thread Kai Krakow
Rich Freeman r-bt...@thefreemanclan.net schrieb: On Sun, Mar 29, 2015 at 7:43 AM, Kai Krakow hurikha...@gmail.com wrote: With the planned performance improvements, I'm guessing the best way will become mounting the root subvolume (subvolid 0) and letting duperemove work on that as a whole -

Re: btrfs dedup - available or experimental? Or yet to be?

2015-03-29 Thread Rich Freeman
On Sun, Mar 29, 2015 at 7:43 AM, Kai Krakow hurikha...@gmail.com wrote: With the planned performance improvements, I'm guessing the best way will become mounting the root subvolume (subvolid 0) and letting duperemove work on that as a whole - including crossing all fs boundaries. Why cross

Re: btrfs dedup - available or experimental? Or yet to be?

2015-03-29 Thread Christoph Anton Mitterer
On Sun, 2015-03-29 at 13:43 +0200, Kai Krakow wrote: Concluding that: duperemove should probably not try to become smart about filesystem boundaries. It should either cross them or not as it is now - the option is left to the user (as is the task to supply proper cmdline arguments with

Re: btrfs dedup - available or experimental? Or yet to be?

2015-03-29 Thread Christoph Anton Mitterer
On Sun, 2015-03-29 at 16:44 +0200, Kai Krakow wrote: Yes, the chosen default is probably not the best for this kind of utility. But I suppose it follows the principle of least surprise. At least every utility I'm daily using (like find) follows this default route. But the default with all

Re: btrfs dedup - available or experimental? Or yet to be?

2015-03-29 Thread Kai Krakow
Rich Freeman r-bt...@thefreemanclan.net schrieb: On Thu, Mar 26, 2015 at 8:07 PM, Martin m_bt...@ml1.co.uk wrote: Anyone with any comments on how well duperemove performs for TB-sized volumes? Took many hours but less than a day for a few TB - I'm not sure whether it is smart enough to

Re: btrfs dedup - available or experimental? Or yet to be?

2015-03-27 Thread Mark Fasheh
On Fri, Mar 27, 2015 at 12:07:29AM +, Martin wrote: Excellent and very rapid packaging, thanks! Already compiled, installed, and soon to be tried on a test subvolume... Anyone with any comments on how well duperemove performs for TB-sized volumes?

Re: btrfs dedup - available or experimental? Or yet to be?

2015-03-27 Thread Mark Fasheh
On Tue, Mar 24, 2015 at 09:30:52PM -0400, Rich Freeman wrote: On Mon, Mar 23, 2015 at 7:22 PM, Hugo Mills h...@carfax.org.uk wrote: On Mon, Mar 23, 2015 at 11:10:46PM +, Martin wrote: As titled: Does btrfs have dedup (on raid1 multiple disks) that can be enabled? The current

Re: btrfs dedup - available or experimental? Or yet to be?

2015-03-26 Thread Martin
On 25/03/15 01:30, Rich Freeman wrote: On Mon, Mar 23, 2015 at 7:22 PM, Hugo Mills h...@carfax.org.uk wrote: On Mon, Mar 23, 2015 at 11:10:46PM +, Martin wrote: As titled: Does btrfs have dedup (on raid1 multiple disks) that can be enabled? The current state of play is on the wiki:

Re: btrfs dedup - available or experimental? Or yet to be?

2015-03-26 Thread Rich Freeman
On Thu, Mar 26, 2015 at 8:07 PM, Martin m_bt...@ml1.co.uk wrote: Anyone with any comments on how well duperemove performs for TB-sized volumes? Took many hours but less than a day for a few TB - I'm not sure whether it is smart enough to take less time on subsequent scans like bedup. Does

Re: btrfs dedup - available or experimental? Or yet to be?

2015-03-24 Thread Rich Freeman
On Mon, Mar 23, 2015 at 7:22 PM, Hugo Mills h...@carfax.org.uk wrote: On Mon, Mar 23, 2015 at 11:10:46PM +, Martin wrote: As titled: Does btrfs have dedup (on raid1 multiple disks) that can be enabled? The current state of play is on the wiki:

btrfs dedup - available or experimental? Or yet to be?

2015-03-23 Thread Martin
As titled: Does btrfs have dedup (on raid1 multiple disks) that can be enabled? Can anyone relate any experiences? Is there (or will there be,) a bad penalty of fragmentation? (For kernel 3.18.9) Thanks, Martin -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the

Re: btrfs dedup - available or experimental? Or yet to be?

2015-03-23 Thread Hugo Mills
On Mon, Mar 23, 2015 at 11:10:46PM +, Martin wrote: As titled: Does btrfs have dedup (on raid1 multiple disks) that can be enabled? The current state of play is on the wiki: https://btrfs.wiki.kernel.org/index.php/Deduplication Can anyone relate any experiences? duperemove is