Re: Slow random reads, SocketTimeoutExceptions

2012-07-22 Thread Minh Duc Nguyen
Adrien, Your poor random read get performance may be related to your compaction policy. HBase strives to take advantage of data locality by running region servers on data nodes that physically store the region files. However, it is possible (for a variety of reasons) that a region server will

Re: Slow random reads, SocketTimeoutExceptions

2012-07-11 Thread Adrien Mogenet
A cell-size is about 300 bytes in my case. (row-key's length is 32 bytes) In my current scenario, I generated 100 tables with a single column family. I'm inserting between 100k and 300k rows per second, depending on my settings - but it's not the purpose here, I'm mostly trying to get good concurre

Re: Slow random reads, SocketTimeoutExceptions

2012-07-11 Thread Asaf Mesika
What's your cell value size? What do you mean by 100 tables in one column family? Can you please specify what was your insert rate and how many nodes you have? Sent from my iPhone On 11 ביול 2012, at 22:08, Adrien Mogenet wrote: Hi there, I'm discovering HBase and comparing it with other distr

Slow random reads, SocketTimeoutExceptions

2012-07-11 Thread Adrien Mogenet
Hi there, I'm discovering HBase and comparing it with other distributed database I know much better. I am currently stressing my testing platform (servers with 32 GB Ram, 16 GB allocated to HBase JVM) and I'm observing strange performances... I'm putting tons of well-spred data (100 Tables of 100M