Re: HDFS fsck command giving health as corrupt for '/'

2017-02-16 Thread Ravi Prakash
Hi Nishant! I'd suggest reading the HDFS user guide to begin with and becoming familiar with the architecture. https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/HdfsUserGuide.html . Where are the blocks stored on the datanodes? Were they on persistent storage on the EC2

Re: HDFS fsck command giving health as corrupt for '/'

2017-02-16 Thread Nishant Verma
Hi Philippe Yes, I did. I restarted NameNode and other daemons multiple times. I found that all my files had got corrupted somehow. I was able to fix the issue by running below command: hdfs fsck / | egrep -v '^\.+$' | grep -v replica | grep -v Replica But it deleted all the files from my

Re: Certain metric groups are missing when using a custom sink in place of FileSink

2017-02-16 Thread jeff saremi
Just to answer my own concern, this seemed to be a result of lack of metrics for some of those Contexts. Nothing to be alarmed about. From: jeff saremi Sent: Wednesday, February 15, 2017 10:21:51 AM To: user@hadoop.apache.org Subject:

Offline backup of NameNode VERSION file

2017-02-16 Thread ranishrg george
Hello, We are using -fetchImage to do offline backup of 'fsimage'. Since we need VERSION file also to revive the cluster from any disaster, is there any way to do a offline backup VERSION file without login to the NN. Thanks,Ranish