RE: hdfs question when replacing dead node...

2009-07-23 Thread Andy Sautins
rg Subject: Re: hdfs question when replacing dead node... The block reports are every hour by default. They should not cause any false negatives for replication on NN. Andy's observation is not expected AFIK. Andy, please check if you can repeat it.. if it happens again, please file a j

Re: hdfs question when replacing dead node...

2009-07-23 Thread Raghu Angadi
The block reports are every hour by default. They should not cause any false negatives for replication on NN. Andy's observation is not expected AFIK. Andy, please check if you can repeat it.. if it happens again, please file a jira and you can attach your relevant log files there. We have

Re: hdfs question when replacing dead node...

2009-07-23 Thread Aaron Kimball
How fast did you re-run fsck after re-joining the node? fsck returns data based on the latest block reports from datanodes -- these are scheduled to run (I think) every 15 minutes, so the NameNode's state on block replication may be as much as 15 minutes out of date. - Aaron On Thu, Jul 23, 2009

hdfs question when replacing dead node...

2009-07-23 Thread Andy Sautins
I recently had to replace a node on a hadoop 0.20.0 4-node cluster and I can't quite explain what happened. If anyone has any insight I'd appreciate it. When the node failed ( drive failure ) running the command 'hadoop fsck /' correctly showed the data nodes to now be 3 instead of 4 and