Physically moving HDFS cluster to new

2013-04-17 Thread Tom Brown
We have a situation where we want to physically move our small (4 node) cluster from one data center to another. As part of this move, each node will receive both a new FQN and a new IP address. As I understand it, HDFS is somehow tied to the the FQN or IP address, and changing them causes data

Re: Physically moving HDFS cluster to new

2013-04-17 Thread Ted Dunning
It may or may not help you in your current distress, but MapR's distribution could handle this pretty easily. One method is direct distcp between clusters, but you could also use MapR's mirroring capabilities to migrate data. You can also carry a MapR cluster, change the IP addresses and relight

Re: Physically moving HDFS cluster to new

2013-04-17 Thread Azuryy Yu
Data nodes name or IP changed cannot cause your data loss. only kept fsimage(under the namenode.data.dir) and all block data on the data nodes, then everything can be recoveryed when your start the cluster. On Thu, Apr 18, 2013 at 1:20 AM, Tom Brown tombrow...@gmail.com wrote: We have a