Re: Scan performance on compressed column families

2012-11-11 Thread David Koch
Hello Oliver, Thank you for the clarification. As Kevin also pointed out, I guess we will just have to test compression in our environment. Regards, /David On Fri, Nov 9, 2012 at 8:46 PM, Oliver Meyn (GBIF) om...@gbif.org wrote: Hi David, I wrote that blog post and I know that Lars George

Re: Scan performance on compressed column families

2012-11-09 Thread Oliver Meyn (GBIF)
Hi David, I wrote that blog post and I know that Lars George has much more experience than me with tuning HBase, especially in different environments, so weight our opinions accordingly. As he says, it will usually help, and the unusual cases of lower spec'd hardware (that I did those tests

Re: Scan performance on compressed column families

2012-11-07 Thread David Koch
*BUMP* Sorry, /David On Sat, Nov 3, 2012 at 3:57 PM, David Koch ogd...@googlemail.com wrote: Hello, Are scans faster when compression is activated? The HBase book by Lars George seems to suggest so (p424, Section on Compression in chapter Performance Tuning). ... compression usually

Re: Scan performance on compressed column families

2012-11-07 Thread Kevin O'dell
Dave, I would recommend trying it in your environment. Like most tests you can find other blogs that argue the performance is better: http://blog.erdemagaoglu.com/post/4605524309/lzo-vs-snappy-vs-lzf-vs-zlib-a-comparison-of It will depend on your environment, filesize, how well it

Scan performance on compressed column families

2012-11-03 Thread David Koch
Hello, Are scans faster when compression is activated? The HBase book by Lars George seems to suggest so (p424, Section on Compression in chapter Performance Tuning). ... compression usually will yield overall better performance, because the overhead of the CPU performing the compression and de-