HDFS - Consolidate 2 small volumes into 1 large volume

2014-10-21 Thread Brian C. Huffman
All, Is it possible to consolidate two small data volumes (500GB each) into a larger data volume (3TB)? I'm thinking that as long as the block file names and metadata are unique, then I should be able to shut down the datanode and use something like tar or rsync to copy the contents of each

Re: HDFS - Consolidate 2 small volumes into 1 large volume

2014-10-21 Thread Azuryy Yu
yes, you can. stop the cluster, change your hdfs-site.xml on your datanode. (dfs.datanode.dir) to the large volume. copy two small data volumes to the large volumes, which was configured on above. start cluster. then you are done. On Tue, Oct 21, 2014 at 9:57 PM, Brian C. Huffman < bhuff...@etin