Random read operation about hundreds request per second

2014-11-06 Thread zhiyuan yang
Hi, I'm new to hbase. Several days ago I built an web service with hbase as backend. However, when I used ab benchmark to test the performance of read only wordload, the result was only hundreds request per second even hbase cache hit ration was 100%. The architecture of my system is as following

Re: Random read operation about hundreds request per second

2014-11-06 Thread Ted Yu
Can you provide a bit more information about your environment ? hbase release hadoop release hardware config heap size for the daemons Cheers On Thu, Nov 6, 2014 at 5:24 PM, zhiyuan yang wrote: > Hi, > > I'm new to hbase. Several days ago I built an web service with hbase as > backend. > Howev

Re: Random read operation about hundreds request per second

2014-11-07 Thread zhiyuan yang
I used hbase 0.94.18, hadoop 2.4.0 on AWS EMR m1.large with all default heap size. On Thu, Nov 6, 2014 at 10:11 PM, Ted Yu wrote: > Can you provide a bit more information about your environment ? > > hbase release > hadoop release > hardware config > heap size for the daemons > > Cheers > > On T

Re: Random read operation about hundreds request per second

2014-11-07 Thread Pere Kyle
I think it may be a thrift issue, have you tried playing with the connection queues? set hbase.thrift.maxQueuedRequests to 0 From Varun Sharma: "If you are opening persistent connections (connections that never close), you should probably set the queue size to 0. Because those connections will a

Re: Random read operation about hundreds request per second

2014-11-08 Thread zhiyuan yang
I've tried it, but it doesn't work. Could you please tell me what's the typical rps in this kind of scenario? I've no idea about that. On Fri, Nov 7, 2014 at 5:02 PM, Pere Kyle wrote: > I think it may be a thrift issue, have you tried playing with the > connection queues? > set hbase.thrift.maxQ