The thread ended abruptly..Can some suggest a solution for improved random
read performance...Even we are facing a similar issue with multi-gets on a
table with growing data...
On Wed, Apr 17, 2013 at 6:03 PM, Michel Segel michael_se...@hotmail.comwrote:
Wouldn't do that... Changing block size
Moving to HBase user mailing list.
Can you upgrade to newer release such as 0.94.8 ?
Cheers
On Jul 8, 2013, at 4:36 AM, Boris Emelyanov emelya...@post.km.ru wrote:
I'm trying to configure hbase for fully random read performance, my cluster
parameters are:
9 servers as slaves, each has
]
Sent: Saturday, April 13, 2013 11:01 AM
To: user@hbase.apache.org
Subject: HBase random read performance
Hi All,
We are using HBase 0.94.5 and Hadoop 1.0.4.
We have HBase cluster of 5 nodes(5 regionservers and 1 master node). Each
regionserver has 8 GB RAM.
We have loaded 25 millions
filter is enabled.
The
random read performance is 1 records in 23 secs.
Ans2:
We are retrieving all the 1 rows in one call.
Ans3:
Disk detai:
Model Number: ST2000DM001-1CH164
Serial Number: Z1E276YF
Please suggest some more optimization
Thanks
happens.
On 4/15/13 9:04 AM, Ankit Jain ankitjainc...@gmail.com wrote:
Hi Liang,
Thanks Liang for reply..
Ans1:
I tried by using HFile block size of 32 KB and bloom filter is
enabled.
The
random read performance is 1 records in 23 secs.
Ans2
.
On 4/15/13 9:04 AM, Ankit Jain ankitjainc...@gmail.com wrote:
Hi Liang,
Thanks Liang for reply..
Ans1:
I tried by using HFile block size of 32 KB and bloom filter is
enabled.
The
random read performance is 1 records in 23 secs.
Ans2:
We
From: Ted Yu yuzhih...@gmail.com
To: user@hbase.apache.org
Sent: Monday, April 15, 2013 10:03 AM
Subject: Re: 答复: HBase random read performance
This is a related JIRA which should provide noticeable speed up:
HBASE-1935 Scan in parallel
Cheers
On Mon, Apr
-
From: Ankit Jain [ankitjainc...@gmail.com]
Sent: Saturday, April 13, 2013 11:01 AM
To: user@hbase.apache.org
Subject: HBase random read performance
Hi All,
We are using HBase 0.94.5 and Hadoop 1.0.4.
We have HBase cluster of 5 nodes(5 regionservers and 1 master node
Interesting. Can you explain why this happens?
-Original Message-
From: Anoop Sam John [mailto:anoo...@huawei.com]
Sent: Monday, April 15, 2013 3:47 PM
To: user@hbase.apache.org
Subject: RE: HBase random read performance
Ankit
I guess you might be having default HFile
at 4:12 PM, Rishabh Agrawal
rishabh.agra...@impetus.co.in wrote:
Interesting. Can you explain why this happens?
-Original Message-
From: Anoop Sam John [mailto:anoo...@huawei.com]
Sent: Monday, April 15, 2013 3:47 PM
To: user@hbase.apache.org
Subject: RE: HBase random read performance
Hi Liang,
Thanks Liang for reply..
Ans1:
I tried by using HFile block size of 32 KB and bloom filter is enabled. The
random read performance is 1 records in 23 secs.
Ans2:
We are retrieving all the 1 rows in one call.
Ans3:
Disk detai:
Model Number: ST2000DM001-1CH164
Serial
for reply..
Ans1:
I tried by using HFile block size of 32 KB and bloom filter is enabled.
The
random read performance is 1 records in 23 secs.
Ans2:
We are retrieving all the 1 rows in one call.
Ans3:
Disk detai:
Model Number: ST2000DM001-1CH164
Serial Number: Z1E276YF
Please
.
The
random read performance is 1 records in 23 secs.
Ans2:
We are retrieving all the 1 rows in one call.
Ans3:
Disk detai:
Model Number: ST2000DM001-1CH164
Serial Number: Z1E276YF
Please suggest some more optimization
Thanks,
Ankit Jain
On Mon, Apr 15, 2013 at 5:11
filter is enabled.
The
random read performance is 1 records in 23 secs.
Ans2:
We are retrieving all the 1 rows in one call.
Ans3:
Disk detai:
Model Number: ST2000DM001-1CH164
Serial Number: Z1E276YF
Please suggest some more optimization
Thanks,
Ankit Jain
what
happens.
On 4/15/13 9:04 AM, Ankit Jain ankitjainc...@gmail.com wrote:
Hi Liang,
Thanks Liang for reply..
Ans1:
I tried by using HFile block size of 32 KB and bloom filter is enabled.
The
random read performance is 1 records in 23 secs.
Ans2:
We are retrieving all
,
what's about the size of you key? If it's a 1024 bytes key, 10 000 gets
equals 10MB of data to send Which is a lot.
Do you have more details on your usecase and your goals?
JM
2013/4/13 Harsh J ha...@cloudera.com
We are getting very low random read performance while performing multi
get
from
and 1 master node). Each
regionserver has 8 GB RAM.
We have loaded 25 millions records in HBase table, regions are pre-split
into 16 regions and all the regions are equally loaded.
We are getting very low random read performance while performing multi get
from HBase.
We are passing random 1
millions records in HBase table, regions are pre-split
into 16 regions and all the regions are equally loaded.
We are getting very low random read performance while performing multi
get
from HBase.
We are passing random 1 row-keys as input, while HBase is taking
around
17 secs to return
are getting very low random read performance while performing multi get
from HBase.
We are passing random 1 row-keys as input, while HBase is taking around
17 secs to return 1 records.
Please suggest some tuning to increase HBase read performance.
Thanks,
Ankit Jain
iLabs
--
Thanks,
Ankit Jain
regionserver has 8 GB RAM.
We have loaded 25 millions records in HBase table, regions are pre-split
into 16 regions and all the regions are equally loaded.
We are getting very low random read performance while performing multi get
from HBase.
We are passing random 1 row-keys as input
We are getting very low random read performance while performing multi get
from HBase.
What are you exactly trying to test here though? 1 random rows in
a single multi-get action from a single application thread returning
back the assembled list from across 5 server, in 17s, is an indicator
random read performance on a
cluster
Please reply asap
Thanks,
--
Kevin O'Dell
Customer Operations Engineer, Cloudera
-scm-users scm-us...@cloudera.org
+hbase-u...@hadoop.apache.org
I think YCSB can handle that, but I am not sure about the 100% random part.
On Wed, Sep 26, 2012 at 4:25 AM, Dalia Hassan daliahass...@gmail.comwrote:
Hello,
Could anyone help me how to measure Hbase random read performance
hi,all
I set up a cluster on 4 machine.(1 HMaster,4RegionServer).
Each Machine has a 16G mem, one 2T Sata disk,CentOS 5.3，XFS .
I write 100M data in Hbase,only 1M key/value,so all keys are in only *one*
Store,and only 2 HFiles in that Store.(I used Large Data Set,but random read
performance
.
I write 100M data in Hbase,only 1M key/value,so all keys are in only *one*
Store,and only 2 HFiles in that Store.(I used Large Data Set,but random read
performance is bad,so i try 100M)
Then I test random read with existing keys with only 1 client. But I got a
Bad Performance,About 100ms
set up a cluster on 4 machine.(1 HMaster,4RegionServer).
Each Machine has a 16G mem, one 2T Sata disk,CentOS 5.3，XFS .
I write 100M data in Hbase,only 1M key/value,so all keys are in only
*one*
Store,and only 2 HFiles in that Store.(I used Large Data Set,but random
read
performance is bad
on 4 machine.(1 HMaster,4RegionServer).
Each Machine has a 16G mem, one 2T Sata disk,CentOS 5.3，XFS .
I write 100M data in Hbase,only 1M key/value,so all keys are in only
*one*
Store,and only 2 HFiles in that Store.(I used Large Data Set,but
random
read
performance is bad,so i try 100M
I am currently running under Hbasev0.20.3. I increased the block cache to .4
from .2. The heap size is 2GB.
The default regionserver handler count is 25 in hbase-default.xml. Will try LZO
compression.
What are other performance tunings I can do ?
In particular, will applying HBASE-2180 or
28 matches
Mail list logo
