, 2013 11:01 AM
To: user@hbase.apache.org
Subject: HBase random read performance
Hi All,
We are using HBase 0.94.5 and Hadoop 1.0.4.
We have HBase cluster of 5 nodes(5 regionservers and 1 master node). Each
regionserver has 8 GB RAM.
We have loaded 25 millions records in HBase
Moving to HBase user mailing list.
Can you upgrade to newer release such as 0.94.8 ?
Cheers
On Jul 8, 2013, at 4:36 AM, Boris Emelyanov emelya...@post.km.ru wrote:
I'm trying to configure hbase for fully random read performance, my cluster
parameters are:
9 servers as slaves, each has
]
Sent: Saturday, April 13, 2013 11:01 AM
To: user@hbase.apache.org
Subject: HBase random read performance
Hi All,
We are using HBase 0.94.5 and Hadoop 1.0.4.
We have HBase cluster of 5 nodes(5 regionservers and 1 master node). Each
regionserver has 8 GB RAM.
We have loaded 25 millions
[ankitjainc...@gmail.com]
发送时间: 2013年4月15日 18:53
收件人: user@hbase.apache.org
主题: Re: HBase random read performance
Hi Anoop,
Thanks for reply..
I tried by setting Hfile block size 4KB and also enabled the bloom
filter(ROW). The maximum read performance that I was able
: user@hbase.apache.org
主题: Re: HBase random read performance
Hi Anoop,
Thanks for reply..
I tried by setting Hfile block size 4KB and also enabled the bloom
filter(ROW). The maximum read performance that I was able to
achieve is
1 records in 14 secs (size
]
发送时间: 2013年4月15日 18:53
收件人: user@hbase.apache.org
主题: Re: HBase random read performance
Hi Anoop,
Thanks for reply..
I tried by setting Hfile block size 4KB and also enabled the
bloom
filter(ROW). The maximum read performance that I was able
From: Ted Yu yuzhih...@gmail.com
To: user@hbase.apache.org
Sent: Monday, April 15, 2013 10:03 AM
Subject: Re: 答复: HBase random read performance
This is a related JIRA which should provide noticeable speed up:
HBASE-1935 Scan in parallel
Cheers
On Mon, Apr
-
From: Ankit Jain [ankitjainc...@gmail.com]
Sent: Saturday, April 13, 2013 11:01 AM
To: user@hbase.apache.org
Subject: HBase random read performance
Hi All,
We are using HBase 0.94.5 and Hadoop 1.0.4.
We have HBase cluster of 5 nodes(5 regionservers and 1 master node
Interesting. Can you explain why this happens?
-Original Message-
From: Anoop Sam John [mailto:anoo...@huawei.com]
Sent: Monday, April 15, 2013 3:47 PM
To: user@hbase.apache.org
Subject: RE: HBase random read performance
Ankit
I guess you might be having default HFile
at 4:12 PM, Rishabh Agrawal
rishabh.agra...@impetus.co.in wrote:
Interesting. Can you explain why this happens?
-Original Message-
From: Anoop Sam John [mailto:anoo...@huawei.com]
Sent: Monday, April 15, 2013 3:47 PM
To: user@hbase.apache.org
Subject: RE: HBase random read performance
Jain [ankitjainc...@gmail.com]
发送时间: 2013年4月15日 18:53
收件人: user@hbase.apache.org
主题: Re: HBase random read performance
Hi Anoop,
Thanks for reply..
I tried by setting Hfile block size 4KB and also enabled the bloom
filter(ROW). The maximum read performance that I was able to achieve
...@gmail.com]
发送时间: 2013年4月15日 18:53
收件人: user@hbase.apache.org
主题: Re: HBase random read performance
Hi Anoop,
Thanks for reply..
I tried by setting Hfile block size 4KB and also enabled the bloom
filter(ROW). The maximum read performance that I was able to achieve is
1 records in 14 secs
@hbase.apache.org
主题: Re: HBase random read performance
Hi Anoop,
Thanks for reply..
I tried by setting Hfile block size 4KB and also enabled the bloom
filter(ROW). The maximum read performance that I was able to achieve is
1 records in 14 secs (size of record is 1.6KB).
Please suggest
收件人: user@hbase.apache.org
主题: Re: HBase random read performance
Hi Anoop,
Thanks for reply..
I tried by setting Hfile block size 4KB and also enabled the bloom
filter(ROW). The maximum read performance that I was able to achieve is
1 records in 14 secs (size of record
more info about your DN disk numbers and IO
utils ?
Thanks,
Liang
发件人: Ankit Jain [ankitjainc...@gmail.com]
发送时间: 2013年4月15日 18:53
收件人: user@hbase.apache.org
主题: Re: HBase random read performance
Hi Anoop,
Thanks for reply..
I
Hi Ankit,
Reads might be impacts by many specifications in your system
As proposed above, Bloom filter can help, but also caching, regions size
and splits, etc. If you have only this table in your cluster, and so only
16 regions, you might want to split your table into smaller pieces. Also,
you setup is rather basic with 8gb memory per server. You should run
hadoop/hbase on better hardware than this.
On Sat, Apr 13, 2013 at 7:31 AM, Ankit Jain ankitjainc...@gmail.com wrote:
Hi All,
We are using HBase 0.94.5 and Hadoop 1.0.4.
We have HBase cluster of 5 nodes(5 regionservers and
Hello Ankit,
How exactly are you trying to fetch the data?Some tips to enhance the
reads could be :
Use of scan caching.
Good rowkey design.
Use of block cache.
Properly closing HTable and ResultScanner.
Use of bloom filters.
Use of Filters to limit the search.
Proper use of compression.
Use
Hi All,
We are using HBase 0.94.5 and Hadoop 1.0.4.
We have HBase cluster of 5 nodes(5 regionservers and 1 master node). Each
regionserver has 8 GB RAM.
We have loaded 25 millions records in HBase table, regions are pre-split
into 16 regions and all the regions are equally loaded.
We are
Did you enable bloom filters ?
See http://hbase.apache.org/book.html#schema.bloom
Cheers
On Fri, Apr 12, 2013 at 10:31 PM, Ankit Jain ankitjainc...@gmail.comwrote:
Hi All,
We are using HBase 0.94.5 and Hadoop 1.0.4.
We have HBase cluster of 5 nodes(5 regionservers and 1 master node). Each
We are getting very low random read performance while performing multi get
from HBase.
What are you exactly trying to test here though? 1 random rows in
a single multi-get action from a single application thread returning
back the assembled list from across 5 server, in 17s, is an indicator
21 matches
Mail list logo
