On Fri, Mar 27, 2015 at 12:07:29AM +0000, Martin wrote: > Excellent and very rapid packaging, thanks! > > > Already compiled, installed, and soon to be tried on a test subvolume... > > > Anyone with any comments on how well duperemove performs for TB-sized > volumes?
https://github.com/markfasheh/duperemove/wiki/Performance-Numbers That page has some sample performance numbers. Keep in mind that the tests were done on reasonably nice hardware. TB-size is definitely on the larger end of what I expect it should handling these days. The biggest problem you would see is memory usage - versions 0.09 and below will be storing all hashes in memory so if everything else is fast enough that's likely the first bump you'll hit. Master branch has some code which reduces our memory consumption dramatically by using a bloom filter and temporarily storing them on disk. That branch needs some more features and bug fixing before I'm ready to call it stable. > Does it work across subvolumes? (Presumably not...) Yep it will dedupe across subvolumes for you! --Mark -- Mark Fasheh -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
