Sorry, forgot to mention that, we're using CDH4.3 so Hadoop 2.0.0
I'm not sure exactly what to look for in the namenode logs but grepping for
"lease" only produced a handful of results, all seem benign.
There were two occurrences of this:
2013-06-17 09:58:40,709 INFO
org.apache.hadoop.hdfs.server.
What Hadoop version are you using ?
Can you check NameNode log to see if lease recovery took long time ?
Cheers
On Jun 18, 2013, at 5:11 AM, Eran Kutner wrote:
> Hi,
> We had a brute force cluster shutdown event that was followed by log
> recovery when the cluster went back online.
> The clust
Hi,
We had a brute force cluster shutdown event that was followed by log
recovery when the cluster went back online.
The cluster took hours to split the logs and recover the regions, all of
which might have made sense since we have quite a lot of regions (around
13K) but the weird thing is that the