When I run fsck everything seems fine. Nothing is reported as under-replicated or missing. Like I said in https://issues.apache.org/jira/browse/HDFS-1290 , the crazy thing is these nodes show up in both live nodes and dead nodes. And absolutely no network activity or change in block count for each node. And the same after a restart and another call to -refreshNodes.
Thanks Arun -----Original Message----- From: Michael Segel [mailto:michael_se...@hotmail.com] Sent: Thursday, July 08, 2010 5:45 PM To: common-user@hadoop.apache.org Subject: RE: decommissioning nodes help What happens when you run an fsck? > From: aramakrish...@languageweaver.com > To: hdfs-u...@hadoop.apache.org > CC: common-user@hadoop.apache.org > Date: Thu, 8 Jul 2010 19:14:11 -0500 > Subject: RE: decommissioning nodes help > > And curiously ( albeit alarmingly ), I don't see network activity ( thru > cacti ) on these nodes indicating blocks are being moved to compensate for > the excluded nodes. This is in the past 2 hours since the process was started > ( steps a and b below ). > > Note: I have set dfs.balance.bandwidthPerSec = 2000000 > > Thanks > Arun > > From: Arun Ramakrishnan [mailto:aramakrish...@languageweaver.com] > Sent: Thursday, July 08, 2010 4:59 PM > To: hdfs-u...@hadoop.apache.org > Subject: decommissioning nodes help > > Hi guys > I am a stuck in my attempt to remove nodes from hdfs. > I followed the steps in https://issues.apache.org/jira/browse/HDFS-1125 > > a) add node to dfs.hosts.exclude > > b) dfsadmin -refreshNodes > > c) wait for decom to finish > > d) remove node from both dfs.hosts and dfs.hosts.exclude > > But after step a) and b) how do I know if decommission is complete. > I am in the process of decommissioning 6 nodes and don't want to loose any > blocks ( rep factor is 3 ) with a restart. > > I also opened https://issues.apache.org/jira/browse/HDFS-1290 if anyone is > interested. > > Thanks > Arun > _________________________________________________________________ The New Busy is not the too busy. Combine all your e-mail accounts with Hotmail. http://www.windowslive.com/campaign/thenewbusy?tile=multiaccount&ocid=PID28326::T:WLMTAGL:ON:WL:en-US:WM_HMP:042010_4
