How to replace the storage on a datanode without formatting the namenode?

2009-05-14 Thread Alexandra Alecu
some info on how to add datanodes, but there is not much info on how to remove safely (without losing data etc) datanodes or storage locations on a particular node. Is this possible? Many thanks, Alexandra. -- View this message in context: http://www.nabble.com/How-to-replace-the-storage-on-a

Re: How to replace the storage on a datanode without formatting the namenode?

2009-05-14 Thread Alexandra Alecu
luck the high level of replication will allow a full recovery of the cluster on restart. Is this something that you would advice? Many thanks, Alexandra. -- View this message in context: http://www.nabble.com/How-to-replace-the-storage-on-a-datanode-without-formatting-the-namenode

Re: How to replace the storage on a datanode without formatting the namenode?

2009-05-14 Thread jason hadoop
s ? > > I found some info on how to add datanodes, but there is not much info on > how > to remove safely (without losing data etc) datanodes or storage locations > on > a particular node. > Is this possible? > > Many thanks, > Alexandra. > > > > > > -- &

Re: How to replace the storage on a datanode without formatting the namenode?

2009-05-14 Thread Alexandra Alecu
t easier to put the configuration files in one directory and then create symlinks from all the hadoop home folders to this one configuration directory. Is this what usually people do or have I gone in a completely wrong direction? -- View this message in context: http://www.nabble.com/How-to-replace-the-st

Re: How to replace the storage on a datanode without formatting the namenode?

2009-05-14 Thread Raghu Angadi
Along these lines, even simpler approach I would think is : 1) set data.dir to local and create the data. 2) stop the datanode 3) rsync local_dir network_dir 4) start datanode with data.dir with network_dir There is no need to format or rebalnace. This way you can switch between local and netw

Re: How to replace the storage on a datanode without formatting the namenode?

2009-05-14 Thread jason hadoop
You can have separate configuration files for the different datanodes. If you are willing to deal with the complexity you can manually start them with altered properties from the command line. rsync or other means of sharing identical configs is simple and common. Raghu, your technique will onl

Re: How to replace the storage on a datanode without formatting the namenode?

2009-05-15 Thread Raghu Angadi
jason hadoop wrote: Raghu, your technique will only work well if you can complete steps 1-4 in less than the datanode timeout interval, which may be valid for Alexandria. I believe the timeout is 10 minutes. Correct I should have mentioned it as well. the process should finish in 10 minutes.