HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-12 Thread Serega Sheypak
Hi, I'm using HConnectionManager from java servlet Looks like it's leaking, all my zookeepers complains that there is too many connections from servlet hosts. Typical line from lZK log: oo many connections from /my.tomcat.server.com - max is 60 Here is code sample public class BaseConnection

Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-12 Thread Stack
Does zk count go up on each request to the servlet? Which version of hbase so can try on this end? Do you have some client-side log? Better if you cache the connection rather than make it each time since setup is costly but lets fix first problem first. St.Ack On Fri, Dec 12, 2014 at 2:47 AM,

Re: Possibly unnecessary check in Result.getColumnLatest(byte[] family, byte[] qualifier)

2014-12-12 Thread Stack
Hello Eric: Do you have some sample data that has the binarySearch go off the rails so we can try and figure how it is broke? Thanks, St.Ack On Thu, Dec 11, 2014 at 1:20 PM, Minor, Eric (NE) eric.mi...@classmates.com wrote: Anil, I agree with you that the check you refer to is

Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-12 Thread Serega Sheypak
Hi, I'm using CDH 5.2, 0.98 I don't know how to use it correctly. I've just used this sample: https://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/HConnectionManager.html HConnection connection = HConnectionManager.createConnection(config); HTableInterface table =

Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-12 Thread Stack
I cannot reproduce. I stood up a cdh5.2 server and then copy/pasted your code adding in a put for each cycle. I ran loop 1000 times and no complaint from zk. Tell me more (Is servlet doing single-threaded model? A single Configuration is being used or new ones are being created per servlet

Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-12 Thread Serega Sheypak
i have 10K doPost/doGet requests per second. Servlet is NOT single-threaded. each doPost/doGet invokes these lines (encapsulated in DAO): 16 HConnection connection = HConnectionManager.createConnection(config); 17 HTableInterface table =

Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-12 Thread Stack
On Fri, Dec 12, 2014 at 11:45 AM, Serega Sheypak serega.shey...@gmail.com wrote: i have 10K doPost/doGet requests per second. How many concurrent threads going on in your tomcat? Is the Connection shared amongst all threads? Perhaps you have 60 concurrent connections running at a time and

RS disk capacity limits

2014-12-12 Thread Krishna
Hi, Is there any logical/practical limit on HBase RS storage size? Which works better for HBase - a region server with 10 disks that are each 2 TB or 2 disks that are each 10TB? I remember, one of the recommendations is to keep each disk on RS to be less than 6 TB - is that correct? Thanks