Re: Slow log splitting (Hbase 0.94.6)

2013-06-18 Thread Eran Kutner
Sorry, forgot to mention that, we're using CDH4.3 so Hadoop 2.0.0 I'm not sure exactly what to look for in the namenode logs but grepping for "lease" only produced a handful of results, all seem benign. There were two occurrences of this: 2013-06-17 09:58:40,709 INFO org.apache.hadoop.hdfs.server.

Re: Slow log splitting (Hbase 0.94.6)

2013-06-18 Thread Ted Yu
What Hadoop version are you using ? Can you check NameNode log to see if lease recovery took long time ? Cheers On Jun 18, 2013, at 5:11 AM, Eran Kutner wrote: > Hi, > We had a brute force cluster shutdown event that was followed by log > recovery when the cluster went back online. > The clust

Slow log splitting (Hbase 0.94.6)

2013-06-18 Thread Eran Kutner
Hi, We had a brute force cluster shutdown event that was followed by log recovery when the cluster went back online. The cluster took hours to split the logs and recover the regions, all of which might have made sense since we have quite a lot of regions (around 13K) but the weird thing is that the