Re: performance of block cache

2014-09-16 Thread Nick Dimiduk
Replying to this thread is getting bounced as spam. Here's the reply I sent yesterday. On Mon, Sep 15, 2014 at 7:52 PM, Nick Dimiduk ndimi...@gmail.com wrote: The explicit JAVA_HOME requirement is new via HBASE-11534. On Mon, Sep 15, 2014 at 3:16 AM, 牛兆捷 nzjem...@gmail.com wrote: It works

Re: performance of block cache

2014-09-16 Thread 牛兆捷
[?] aha. Thanks~ 2014-09-17 1:57 GMT+08:00 Nick Dimiduk ndimi...@gmail.com: Replying to this thread is getting bounced as spam. Here's the reply I sent yesterday. On Mon, Sep 15, 2014 at 7:52 PM, Nick Dimiduk ndimi...@gmail.com wrote: The explicit JAVA_HOME requirement is new via

Re: performance of block cache

2014-09-15 Thread 牛兆捷
java -d64 version works well in the shell. 2014-09-15 11:59 GMT+08:00 牛兆捷 nzjem...@gmail.com: I use hbase-0.98-5-hadoop2 and modify the default heap size of region server in hbase-env.sh as below (keep all the other parameters in the file default): export HBASE_REGIONSERVER_OPTS=-Xmn200m

Re: performance of block cache

2014-09-15 Thread 牛兆捷
It works now by configuring the $JAVA_HOME explicitly. The JAVA_HOME is configured as $JAVA_HOME by default. Now I configure it to the complete path of my JDK explicitly. A little strange here, the $JAVA_HOME is already set in the shell environment, why do I still need to configure it again

Re: performance of block cache

2014-09-14 Thread 牛兆捷
Hi, Nick Can your perf_blockcache performance testing script can be applied to hbase cluster directly? If not, what kind of things should I take care? 2014-08-22 7:06 GMT+08:00 Nick Dimiduk ndimi...@gmail.com: I'm familiar with Stack's work too, but thanks for pointing it out :) On Wed, Aug

Re: performance of block cache

2014-09-14 Thread Nick Dimiduk
The scripts automate use of the tool PerformanceEvaluation that ships with HBase, so in that way it runs against a cluster directly. It depends on having independent configuration directories set up for each test config. There's probably too much custom-to-my-environment stuff in there, but I hope

Re: performance of block cache

2014-09-14 Thread 牛兆捷
I use hbase-0.98-5-hadoop2 and modify the default heap size of region server in hbase-env.sh as below (keep all the other parameters in the file default): export HBASE_REGIONSERVER_OPTS=-Xmn200m -XX:CMSInitiatingOccupancyFraction=70 -Xms1024m -Xmx8000m The error occurs when I start hbase

Re: performance of block cache

2014-08-21 Thread Nick Dimiduk
I'm familiar with Stack's work too, but thanks for pointing it out :) On Wed, Aug 20, 2014 at 8:19 PM, 牛兆捷 nzjem...@gmail.com wrote: Hi Nick: Yes, I am interested in it. I will try first. Btw, this site (http://people.apache.org/~stack/bc/) also does the similar performance evaluation.

Re: performance of block cache

2014-08-20 Thread 牛兆捷
the complete blog link is: http://zh.hortonworks.com/blog/blockcache-showdown-hbase/ 2014-08-20 11:41 GMT+08:00 牛兆捷 nzjem...@gmail.com: Hi all: I saw some interesting results from Hortonworks blog (block cache http://zh.hortonworks.com/wp-content/uploads/2014/03/perfeval_blockcache_v2.pdf

Re: performance of block cache

2014-08-20 Thread Nick Dimiduk
Hi Zhaojie, I'm responsible for this particular bit of work. One thing to note in these experiments is that I did not control explicitly for OS caching. I ran warmup workloads before collecting measurements, but because the amount of RAM on the machine is fixed, it's impact of OS cache is

Re: performance of block cache

2014-08-20 Thread 牛兆捷
Hi Nick: Yes, I am interested in it. I will try first. Btw, this site (http://people.apache.org/~stack/bc/) also does the similar performance evaluation. You can have a look if you are interested in. 2014-08-21 1:48 GMT+08:00 Nick Dimiduk ndimi...@gmail.com: Hi Zhaojie, I'm responsible for

performance of block cache

2014-08-19 Thread 牛兆捷
Hi all: I saw some interesting results from Hortonworks blog (block cache http://zh.hortonworks.com/wp-content/uploads/2014/03/perfeval_blockcache_v2.pdf ). In this result, the ratio of memory footprint to database size is held fixed while the absolute values are increased. In my mind, the

Is there any influence to put performance when Block cache LRU eviction occur?

2011-04-21 Thread Zhoushuaifeng
I'm running random scan and put performance test at the same time, found that put performance descend a lot. Don't know why. Looking into the logs, found that Block cache LRU eviction occured almost once per second. But it only last about 10 ms, so, will it bring so much influence to put

Re: Is there any influence to put performance when Block cache LRU eviction occur?

2011-04-21 Thread Stack
On Thu, Apr 21, 2011 at 7:00 PM, Zhoushuaifeng zhoushuaif...@huawei.com wrote: I'm  running random scan and put performance test at the same time, found that put performance descend a lot. Don't know why. Looking into the logs, found that Block cache LRU eviction occured almost once per  

Re: Is there any influence to put performance when Block cache LRU eviction occur?

2011-04-21 Thread Zhoushuaifeng
Zhou Shuaifeng(Frank) -邮件原件- 发件人: saint@gmail.com [mailto:saint@gmail.com] 代表 Stack 发送时间: 2011年4月22日 11:11 收件人: user@hbase.apache.org 抄送: Yanlijun 主题: Re: Is there any influence to put performance when Block cache LRU eviction occur? On Thu, Apr 21, 2011 at 7:00 PM, Zhoushuaifeng