Re: Hbql with Hbase-0.90.4

On Fri, Apr 27, 2012 at 12:06 AM, Manu S wrote: > Hi, > > I am trying to install Hbql on pseudo distributed node. I am not sure how > to build the *hbase-trx-0.90.0-DEV-2.jar* from hbase-transactional package > which was downloaded from * > https://github.com/hbase-trx/hbase-transactional-tableind

Re: HBase Thrift for CDH3U3 leaking file descriptors/socket connections to Zookeeper

Cool thanks Joey... What I also noticed is that the number of threads spawned by the Thrift server also goes to > 16000 when the number of file descriptors is going to > 32000.. Probably we are not re-using threads in a correct way and we are missing the option to limit the number of threads (whic

Re: HBase Thrift for CDH3U3 leaking file descriptors/socket connections to Zookeeper

I don't have the code in front of me, but I bet we're not reusing the Configuration object when getting the HTable handle. I'll take a look at when the regression went in this evening. -Joey Sent from my iPhone On Apr 27, 2012, at 14:02, Dhaval Y Shah wrote: > > We have an app written in R

HBase Thrift for CDH3U3 leaking file descriptors/socket connections to Zookeeper

We have an app written in Ruby which uses HBase as the backing store.. It uses Thrift to connect to it.. We were using HBase from Cloudera's CDH3B4 distro until now and it worked fine.. I just upgraded our Hadoop install to CDH3U3 (which is the latest stable CDH release at this point) and in a

Re: HBase with C++

Check out this code for help http://svn.apache.org/repos/asf/hbase/trunk/src/examples/thrift/DemoClient.cpp On Fri, Apr 27, 2012 at 9:06 PM, Srinivas Krishnan wrote: > Tom, > > Thanks, taking a look at actual examples would help us a lot. > > One of the concerns we have Thrift is how the writes

Re: Best Hbase Storage for PIG

A lot of factors can affect HBase performance.. could even be some hardware related (slow network, or disk).. How fast can you scan? does that work well? You could take jstack of the clients (reducer) and region servers when you are writing and post them and/or hbase list. This would point to wher

Re: HBase Thrift for CDH3U3 leaking file descriptors/socket connections to Zookeeper

>From top of my head see if you are hitting https://issues.apache.org/jira/browse/HBASE-4508 (and hence https://issues.apache.org/jira/browse/HBASE-3777) , 4508 is back port of 3777 and has a new config which may help you. Of course it depends on if the new hbase version you are running has 4508 or

HBase Thrift for CDH3U3 leaking file descriptors/socket connections to Zookeeper

We have an app written in Ruby which uses HBase as the backing store.. It uses Thrift to connect to it.. We were using HBase from Cloudera's CDH3B4 distro until now and it worked fine.. I just upgraded our Hadoop install to CDH3U3 (which is the latest stable CDH release at this point) and in a

Re: HBase with C++

Tom, Thanks, taking a look at actual examples would help us a lot. One of the concerns we have Thrift is how the writes will get distributed across the Region Servers, this is still a new paradigm for us moving away from MySQL, so any insights on that would be great. thanks -srinivas On Fri, A

Re: Hbql with Hbase-0.90.4

Hi, I am trying to install Hbql on pseudo distributed node. I am not sure how to build the *hbase-trx-0.90.0-DEV-2.jar* from hbase-transactional package which was downloaded from * https://github.com/hbase-trx/hbase-transactional-tableindexed* Appreciate your help on the same. -- > Thanks & Reg

Re: HBase with C++

I have some simple C++ thrift codes that create & delete tables, show the status of all tables in an hbase, a simple delim sep line inserter and simple scanner. These are not production codes, but I have craeted multi-million line tables with them. I can send them to you if you'd like to see some

Hbql with Hbase-0.90.4

Hi, I am trying to install Hbql on pseudo distributed node. I am not sure how to build the *hbase-trx-0.90.0-DEV-2.jar* from hbase-transactional package which was downloaded from * https://github.com/hbase-trx/hbase-transactional-tableindexed* Appreciate your help on the same. -- Thanks & Regar

Re: Exceptions with importtsv

I am able to run this command but it goes on forever. I don't see any data uploaded. This is what I see on the console. http://pastebin.com/J2WApji1 Any idea on how to debug this? On Fri, Apr 27, 2012 at 11:30 AM, Sambit Tripathy wrote: > Thanks all for the reply. > > I am able to run this

Re: Are minor compaction and major compaction different in HBase 0.92?

Thanks for your reply. I install HBase in pseudo-mode. I think my situation is that the minor compaction promotes to major compaction. I have 3 HFiles for table 'test' in one RegionServer. After I issued compact (org.apache.hadoop.hbase.client.HBaseAdmin.compact()) method, those 3 HFiles are com