Re: Hbase Quality Of Service: large standarad deviation in insert time while inserting same type of rows in Hbase

2012-04-25 Thread Doug Meil
Hi there- In addition to what was said about GC, you might want to double-check this... http://hbase.apache.org/book.html#performance ... as well as this case-study for performance troubleshooting http://hbase.apache.org/book.html#casestudies.perftroub On 4/24/12 9:58 PM, "Michael Segel"

Re: Hbase Quality Of Service: large standarad deviation in insert time while inserting same type of rows in Hbase

2012-04-25 Thread Michel Segel
I guess Sesame Street isn't global... ;-) oh and of course I f'd the joke by saying Grover and not Oscar so it's my bad. :-(. [Google Oscar the groutch, and you'll understand the joke that I botched] Its most likely GC and a mis tuned cluster. The OP doesn't really get in to detail, except to sa

Re: Hbase Quality Of Service: large standarad deviation in insert time while inserting same type of rows in Hbase

2012-04-24 Thread Mikael Sitruk
1. writes are not blocked during compaction 2. compaction cannot have a constant time since the files/regions are getting bigger 3. beside the GC pauses (which seems to be the best candidate here) on either the client or RS (what are your setting BTW, and data size per insert), did you presplit you

Re: Hbase Quality Of Service: large standarad deviation in insert time while inserting same type of rows in Hbase

2012-04-24 Thread Michael Segel
Have you thought about Garbage Collection? -Grover Sent from my iPhone On Apr 24, 2012, at 12:41 PM, "Skchaudhary" wrote: > > I have a cluster Hbase set-up. In that I have 3 Region Servers. There is a > table which has 27 Regions equally distributed among 3 Region servers--9 > regions per reg