Arun, Did you specify dfs.hosts.exclude before the NameNode started? If not, you will have to restart the NameNode. Otherwise, just kill the DataNode.
On Thu, Jul 8, 2010 at 10:01 PM, Arun Ramakrishnan < aramakrish...@languageweaver.com> wrote: > When I run fsck everything seems fine. Nothing is reported as > under-replicated or missing. > Like I said in https://issues.apache.org/jira/browse/HDFS-1290 , the crazy > thing is these nodes show up in both live nodes and dead nodes. > And absolutely no network activity or change in block count for each node. > And the same after a restart and another call to -refreshNodes. > > Thanks > Arun > > > -----Original Message----- > From: Michael Segel [mailto:michael_se...@hotmail.com] > Sent: Thursday, July 08, 2010 5:45 PM > To: common-user@hadoop.apache.org > Subject: RE: decommissioning nodes help > > > What happens when you run an fsck? > > > From: aramakrish...@languageweaver.com > > To: hdfs-u...@hadoop.apache.org > > CC: common-user@hadoop.apache.org > > Date: Thu, 8 Jul 2010 19:14:11 -0500 > > Subject: RE: decommissioning nodes help > > > > And curiously ( albeit alarmingly ), I don't see network activity ( thru > cacti ) on these nodes indicating blocks are being moved to compensate for > the excluded nodes. This is in the past 2 hours since the process was > started ( steps a and b below ). > > > > Note: I have set dfs.balance.bandwidthPerSec = 2000000 > > > > Thanks > > Arun > > > > From: Arun Ramakrishnan [mailto:aramakrish...@languageweaver.com] > > Sent: Thursday, July 08, 2010 4:59 PM > > To: hdfs-u...@hadoop.apache.org > > Subject: decommissioning nodes help > > > > Hi guys > > I am a stuck in my attempt to remove nodes from hdfs. > > I followed the steps in https://issues.apache.org/jira/browse/HDFS-1125 > > > > a) add node to dfs.hosts.exclude > > > > b) dfsadmin -refreshNodes > > > > c) wait for decom to finish > > > > d) remove node from both dfs.hosts and dfs.hosts.exclude > > > > But after step a) and b) how do I know if decommission is complete. > > I am in the process of decommissioning 6 nodes and don't want to loose > any blocks ( rep factor is 3 ) with a restart. > > > > I also opened https://issues.apache.org/jira/browse/HDFS-1290 if anyone > is interested. > > > > Thanks > > Arun > > > > _________________________________________________________________ > The New Busy is not the too busy. Combine all your e-mail accounts with > Hotmail. > > http://www.windowslive.com/campaign/thenewbusy?tile=multiaccount&ocid=PID28326::T:WLMTAGL:ON:WL:en-US:WM_HMP:042010_4 >
