Re: Does compression ever improve performance?

2014-06-13 Thread jeremy p
Thank you -- I'll go ahead and try compression. --Jeremy On Fri, Jun 13, 2014 at 10:59 AM, Dima Spivak wrote: > I'd highly recommend it. In general, compressing your column families will > improve performance by reducing the resources required to get data from > disk (even when taking into acc

Re: Does compression ever improve performance?

2014-06-13 Thread Dima Spivak
I'd highly recommend it. In general, compressing your column families will improve performance by reducing the resources required to get data from disk (even when taking into account the CPU overhead of compressing and decompressing). -Dima On Fri, Jun 13, 2014 at 10:35 AM, jeremy p wrote: > H

Does compression ever improve performance?

2014-06-13 Thread jeremy p
Hey all, Right now, I'm not using compression on any of my tables, because our data doesn't take up a huge amount of space. However, I would turn on compression if there was a chance it would improve HBase's performance. By performance, I'm talking about the speed with which HBase responds to re

Re: HFile V2 vs HFile V3

2014-06-13 Thread Andrew Purtell
If you read down through that JIRA, you'll have the answer to that question: The results were inconclusive and the changes in that patch broke thread safety. I also suggest returning to the bottom of the Cassandra wiki page you mentioned and follow the link to the JIRA. Cassandra appears to have n

Re: HFile V2 vs HFile V3

2014-06-13 Thread abhishek1015
Thanks ted for providing the link to HBase-5313. Apparently, no one seems to work on this which is strange. Abhishek -- View this message in context: http://apache-hbase.679495.n3.nabble.com/HFile-V2-vs-HFile-V3-tp4060405p4060418.html Sent from the HBase User mailing list archive at Nabble.c

Re: HFile V2 vs HFile V3

2014-06-13 Thread Ted Yu
w.r.t. columnar format, there were discussions in the past: https://issues.apache.org/jira/browse/HBASE-5313?focusedCommentId=13203324&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13203324 HBASE-5521 Move compression/decompression to an encoder specific encoding c

master caught a ClosedChannelException

2014-06-13 Thread sunweiwei
Hi I'm using hbase0.96. When I start hamster , it's ok. After a little while, I saw these in logs. 2014-06-13 18:10:15,073 WARN [RpcServer.handler=48,port=6] ipc.RpcServer: RpcServer.respondercallId: 206739 service: RegionServerStatusService methodName: RegionServerReport size: 79.5 K

Re: high load average in one region server

2014-06-13 Thread Wellington Chevreuil
Might be worth check hbase ui (http://hbase-host:60010/), you will see a page where there is a table “Region Servers”, and you can check there if regions are evenly spread around your RS. From there, you can click on the link for each of your RS, and you can find more information specific for ea

HBase jar for sqoop import

2014-06-13 Thread Alberto Crespi
Hello, i'm using cdh 5.0.1 i'm trying to import data into hbase using sqoop. i launch my sqoopaction in oozie import --connect jdbc:mysql://10.0.0.221/db --username XXX --password XXX --table test -m 1 --target-dir /user/import --incremental lastmodified --check-column date --append --hbase-table