Test results for [RFC PATCH v10 00/16] Online(inband) data deduplication

2014-04-14 Thread Konstantinos Skarlatos
Hello, Here are the test results from my testing of the latest patches of btrfs dedup. TLDR; I rsynced 10 separate copies of a 3.8GB folder with 138 RAW photographs (23-36MiB) on a btrfs volume with dedup enabled. On the first try, the copy was very slow, and a sync after that took over 10

Re: [RFC PATCH v10 00/16] Online(inband) data deduplication

2014-04-11 Thread Martin Steigerwald
Hi Liu, Am Donnerstag, 10. April 2014, 23:55:21 schrieb Liu Bo: Hi, Just FYI, these patches are also available on the following site, kernel: https://github.com/liubogithub/btrfs-work.git dedup-on-3.14-linux progs: https://github.com/liubogithub/btrfs-progs.git dedup I bet its good

Re: [RFC PATCH v10 00/16] Online(inband) data deduplication

2014-04-11 Thread Liu Bo
On Fri, Apr 11, 2014 at 11:28:48AM +0200, Martin Steigerwald wrote: Hi Liu, Am Donnerstag, 10. April 2014, 23:55:21 schrieb Liu Bo: Hi, Just FYI, these patches are also available on the following site, kernel: https://github.com/liubogithub/btrfs-work.git dedup-on-3.14-linux

Re: [RFC PATCH v10 00/16] Online(inband) data deduplication

2014-04-11 Thread Michael
Hi Liu, Thanks for your work. Each test copy 2gb file from sdf (btrfs) to sde (btrfs with dedup 4k blocksize). Before every test i recreate filesystem. On second write all goods. Test 1 Nodesize = leafsize = 4k Write overhead ~ x1.5 Test 2 Nodesize = leafsize = 16k Write overhead ~ x19

Re: [RFC PATCH v10 00/16] Online(inband) data deduplication

2014-04-10 Thread Konstantinos Skarlatos
On 10/4/2014 6:48 πμ, Liu Bo wrote: Hello, This the 10th attempt for in-band data dedupe, based on Linux _3.14_ kernel. Data deduplication is a specialized data compression technique for eliminating duplicate copies of repeating data.[1] This patch set is also related to Content based storage

Re: [RFC PATCH v10 00/16] Online(inband) data deduplication

2014-04-10 Thread Liu Bo
On Thu, Apr 10, 2014 at 12:08:17PM +0300, Konstantinos Skarlatos wrote: On 10/4/2014 6:48 πμ, Liu Bo wrote: Hello, This the 10th attempt for in-band data dedupe, based on Linux _3.14_ kernel. Data deduplication is a specialized data compression technique for eliminating duplicate copies

Re: [RFC PATCH v10 00/16] Online(inband) data deduplication

2014-04-10 Thread Liu Bo
Hi, Just FYI, these patches are also available on the following site, kernel: https://github.com/liubogithub/btrfs-work.git dedup-on-3.14-linux progs: https://github.com/liubogithub/btrfs-progs.git dedup thanks, -liubo On Thu, Apr 10, 2014 at 11:48:30AM +0800, Liu Bo wrote: Hello, This

[RFC PATCH v10 00/16] Online(inband) data deduplication

2014-04-09 Thread Liu Bo
Hello, This the 10th attempt for in-band data dedupe, based on Linux _3.14_ kernel. Data deduplication is a specialized data compression technique for eliminating duplicate copies of repeating data.[1] This patch set is also related to Content based storage in project ideas[2], it introduces