Re: why reduce doesn't work by HBase?

2012-11-16 Thread yonghu
Thanks for your suggestions On Thu, Nov 15, 2012 at 9:56 PM, Bertrand Dechoux wrote: > Hi Yong, > > A few ways to understand a problem (with Hadoop) : > 1) Write tests, using MRUnit for example (http://mrunit.apache.org/) > 2) Use @Override to make sure you are indeed overriding a method > 3) Use

Re: Lots of SocketTimeoutException for gets and puts since HBase 0.92.1

2012-11-16 Thread Vincent Barat
Le 16/11/12 01:56, Stack a écrit : On Thu, Nov 15, 2012 at 5:21 AM, Guillaume Perrot wrote: It happens when several tables are being compacted and/or when there is several scanners running. It happens for a particular region? Anything you can tell about the server looking in your cluster mon

Re: Lots of SocketTimeoutException for gets and puts since HBase 0.92.1

2012-11-16 Thread Ted Yu
Vincent: What's the value for hbase.regionserver.handler.count ? I assume you keep the same value as that from 0.90.3 Thanks On Fri, Nov 16, 2012 at 8:14 AM, Vincent Barat wrote: > Le 16/11/12 01:56, Stack a écrit : > > On Thu, Nov 15, 2012 at 5:21 AM, Guillaume Perrot >> wrote: >> >>> It hap

Re: Lots of SocketTimeoutException for gets and puts since HBase 0.92.1

2012-11-16 Thread Vincent Barat
Hi, Right now (and previously with 0.90.3) we were using the default value (10). We are trying right now to increase to 30 to see if it is better. Thanks for your concern Le 16/11/12 18:13, Ted Yu a écrit : Vincent: What's the value for

increasing block cache size

2012-11-16 Thread Ted Tuttle
Hello All- We are running 5 node v0.94 cluster on machines w/ 32G of RAM. I'd like to utilize more of our memory for block cache. So I have a couple of questions. Currently, we are running RSs w/ 16G heap and the following memory settings: hfile.block.cache.size=0.25 hbase.region

Re: Client with HTablePool can't connect after server restart

2012-11-16 Thread Scott Alcaide
Any update on this? We encountered this on a production cluster. Did the zookeeper bug ever get filed or fixed?

Re: Lots of SocketTimeoutException for gets and puts since HBase 0.92.1

2012-11-16 Thread Vincent Barat
Hi, Right now (and previously with 0.90.3) we were using the default value (10). We are trying right now to increase to 30 to see if it is better. Thanks for your concern Le 16/11/12 18:13, Ted Yu a écrit : Vincent: What's the value for hbase.regionserver.handler.count ? I assume you keep t

Help with Selective replication in Hbase

2012-11-16 Thread techbuddy
Hi, I need to be able to selectively replicate the mutations from my master cluster into my backup/slave cluster,based on some application specific policy.In other words I want to suppress replication of certain mutation events, and allow the same only for the rest. The ReplicationSinkService int

Re: How to check if a major_compact is done?

2012-11-16 Thread yun peng
Hi, as I recently find out, by spinning on getStorefiles == task.getStores() may not be a robust method to check if a compaction is done. For instance, if the interval for checking is set too large and there are compaction and flushes intertwined together, then in the end, getStorefiles() may not

Re: region server not response

2012-11-16 Thread yutoo yanio
my region server stopped after 30 minutes this my shutdown log after "2012-11-15 15:38:44,170 INFO org.apache.hadoop.hbase.regionserver.Leases: regionserver60020.leaseChecker closed leases" wait about 30mins and "2012-11-15 16:08:10,361 INFO org.apache.hadoop.hbase.regionserver.StoreFile: NO Ge

Re: region server not response

2012-11-16 Thread yutoo yanio
i said that not exception occurred On Sat, Nov 17, 2012 at 8:31 AM, ramkrishna vasudevan < ramkrishna.s.vasude...@gmail.com> wrote: > Could you send the exact Exception that you had got. The logs that you > have attached comes after the region server starts going down. > > Regards > Ram > > On S