Re: sub-file dedup

2019-05-30 Thread Austin S. Hemmelgarn
On 2019-05-29 21:13, Newbugreport wrote: I'm experimenting with the rsync algorithm for btrfs deduplication. Every other deduplication tool I've seen works against whole files. I'm concerned about deduping chunks under 4k and about files with scattered extents. AFAIK, regions smaller than the F

sub-file dedup

2019-05-29 Thread Newbugreport
I'm experimenting with the rsync algorithm for btrfs deduplication. Every other deduplication tool I've seen works against whole files. I'm concerned about deduping chunks under 4k and about files with scattered extents. Are there best practices for deduplication on btrfs?