RPC - Queue Time when handlers are all waiting

2013-12-05 Thread Federico Gaule
Hi, I have 2 clusters, Master (a) - Slave (b) replication. B doesn't have client write or reads, all handlers (100) are waiting but rpc.metrics.RpcQueueTime_num_ops and rpc.metrics.RpcQueueTime_avg_time reports to be rpc calls to be queued. There are some screenshots below to show ganglia

HBase snapshot export - mappers

2013-12-05 Thread oc tsdb
Hi, While exporting HBase snapshots we need to specify number of mappers to use as mentioned below.To get better performance how many mappers can be used and please let us know based on which parameters we need to decide on number of mappers to use.I am new to HBase. Please refer if there are

Re: Strange Problem on using HRegion's getScanner Method in RegionServer

2013-12-05 Thread Wukang Lin
hi Asaf, Thank you for your response. the rpc server in my application is a singleton instance. It is started in a region observer, and work as a single server in the HRegionServer, just like the RPC servers bring up in the RS's main() Method. It not attatched with any Table or regions, It can

Re: HBase snapshot export - mappers

2013-12-05 Thread Matteo Bertozzi
to make it simple, the number of mappers is the number of machines that you want to use. each machine will get N files to copy based on: total files to export / nmappers Matteo On Thu, Dec 5, 2013 at 12:58 PM, oc tsdb oc.t...@gmail.com wrote: Hi, While exporting HBase snapshots we need to

Socket Timeout in Secure Mode

2013-12-05 Thread Bill Sanchez
I see the following exception when running in secure mode using Kerberos. The exception appears to happen only under load and not consistently. It seems to be somewhat similar to the bug below but the exceptions are different. I am using 0.94.13. Any advice is appreciated.

Re: Strange Problem on using HRegion's getScanner Method in RegionServer

2013-12-05 Thread Gary Helmling
hi Asaf, Thank you for your response. the rpc server in my application is a singleton instance. It is started in a region observer, and work as a single server in the HRegionServer, just like the RPC servers bring up in the RS's main() Method. It not attatched with any Table or regions,

Re: Practical Upper Limit on Number of Version Stored?

2013-12-05 Thread Shawn Hermans
My guess is 50 to 200 versions.  Row size is around 300KB of data.  — Sent from Mailbox for iPhone On Thu, Dec 5, 2013 at 6:41 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi Shawn, I personnaly like and often suggest this approach. However you need to be aware that there is an

Re: Practical Upper Limit on Number of Version Stored?

2013-12-05 Thread Michael Segel
You really don't want to do this. Its not what the versioning was meant for and it has a couple of serious flaws. The biggest flaw... what happens when you want to delete a version? ... There are other options... depending on your use case and how you use the events. Truly using versioning

Re: Practical Upper Limit on Number of Version Stored?

2013-12-05 Thread Shawn Hermans
I guess I don't really understand why I wouldn't want to do this.  For our use case we only really care about the user's last 50 to 200 events.  We don't really care about deleting events explicitly.  More than likely we would enable a TTL to get rid of events older than a certain time.   I

Re: Practical Upper Limit on Number of Version Stored?

2013-12-05 Thread Jean-Marc Spaggiari
And the respons is no. You don't have that much version. Up to 200 is not critical. Also you can easily give that a try. JM Le 2013-12-05 20:27, Shawn Hermans shawnherm...@gmail.com a écrit : I guess I don't really understand why I wouldn't want to do this. For our use case we only really

Re: Practical Upper Limit on Number of Version Stored?

2013-12-05 Thread Bryan Beaudreault
I generally agree with Michael and avoid using versions for anything other than versioning, but mostly out of personal preference. That said, I also agree with JM that 50-200 should be no problem at all. We did do this in our early days of HBase, and eventually moved away from it for a few

Re: Practical Upper Limit on Number of Version Stored?

2013-12-05 Thread Michael Segel
You want the last n events? Column name is (Epoch - timestamp)+event name or something Then just return up to n columns The events are in reverse order. Sent from a remote device. Please excuse any typos... Mike Segel On Dec 5, 2013, at 7:27 PM, Shawn Hermans shawnherm...@gmail.com wrote:

RE: Practical Upper Limit on Number of Version Stored?

2013-12-05 Thread Vladimir Rodionov
Version is just a timestamp (event time) = naturally fits time-series (event) types of data. Besides this, events are immutable objects, if they are not, not than they are not events. Best regards, Vladimir Rodionov Principal Platform Engineer Carrier IQ, www.carrieriq.com e-mail:

How to convert SequenceFile into HFile?

2013-12-05 Thread Igor Gatis
I have SequenceFiles I'd like to convert to HFile. How do I that?

Does HBase Java Client compatible to all the hbase distributions?

2013-12-05 Thread jingych
Hi, All! Does HBase Java Client compatible to all the hbase distributions? If don't,how to distinguish that? Actually, I just want to know that if I wrote the write data to HBase logic onece, and it will run any hbase. Thanks! Best regards! jingych