Re: [RFB] add LZ4 compression method to btrfs

2012-02-16 Thread Hugo Chevrain
You're right about the broken links, my bad.


The first link related to a few statements by Mark Ruijter, copy/pasted below :

> I just looked into it and it appears to be promising. 
> On average the speeds appear to be 48% faster then snappy.
> This is amazing since snappy has proved to be 30% faster then QuickLZ 
> which once was the fastest compression protocol.

==> http://www.lessfs.com/wordpress/?p=684#comments

> I did not test LZ4 on high end hardware yet. 
> However even on my laptop it is clear that LZ4 does outperform snappy. 
> With the hardware being the bottleneck 
> LZ4 still manages to speed things up by 2~5%. 
> Most likely the difference will be larger when fast hardware is used

==> http://www.lessfs.com/wordpress/?p=688

There is no precise benchmark though. Just this sentence :

> I will post the exact performance numbers on low and high end hardware 
> after testing has finished.

So maybe someone has to ask Mark about these results.


The second link initially linked to Hadoop, which recently decided to integrate
LZ4 compression :
==> https://issues.apache.org/jira/browse/HADOOP-7657

However, since then, i've discovered the website of the developper in charge of
this patch (Binglin Chang), and he has come nice comparison figures available.
The main summary is copy/pasted below :

> Perf.RawCompressionLZ4Block size: 64K
> Compress:  428M/s Decompress:   681M/s( 1584M/s) ratio: 43.0% - Total

> Perf.RawCompressionSnappy Block size: 64K
> Compress:  400M/s Decompress:   442M/s(  979M/s) ratio: 45.2% - Total

==> https://github.com/decster/jnicompressions/blob/master/README.md


--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html


Re: [RFB] add LZ4 compression method to btrfs

2012-02-14 Thread Hugo Chevrain
> 
> Are you sure about these figures ? the difference seems too large. It's 
almost
> unbelievable.
> 
> --

You should not, 
Mark Ruijter found the same for LessFS (http://www.lessfs.com/wordpress/?
p=688) and there is also such finding into an Hadoop thread 
(https://scribe.twitter.com/#!/otisg/status/148848850914902016)



--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html


Re: Updated btrfs/crypto snappy interface ready for merging

2012-01-24 Thread Hugo Chevrain
> evergreen writes:
> > 
> 
> Although there is LessFS's Mark Ruijter :
> http://www.lessfs.com/wordpress/?p=684&cpage=1#comment-3114
> 
> "On average the speeds appear to be 48% faster then snappy."
> Sounds promising...
> 
> --

Well, it seems that the performance is really good.
Apparently, LZ4 has displaced Snappy as speed champion for LessFS.

http://www.lessfs.com/wordpress/?p=688



--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html