Re: PendingDeletionBlocks immediately after Namenode failover

2017-11-13 Thread Ravi Prakash
Hi Michael! Thank you for the report. I'm sorry I don't have advice other than the generic advice, like please try a newer version of Hadoop (say Hadoop-2.8.2) . You seem to already know that the BlockManager is the place to look. If you found it to be a legitimate issue which could affect

PendingDeletionBlocks immediately after Namenode failover

2017-11-08 Thread Michael Parkin
Hello, We're seeing some unusual behavior in our two HDFS 2.6.0 (CDH5.11.1) clusters and was wondering if you could help. When we failover our Namenodes we observe a large number of PendingDeletionBlocks blocks - i.e., the metric is zero before failover and several thousand after. This seems