I agree, distcp is the way to go here, you can specify down to the individual directory on HDFS. Also, you can add some flags to overwrite/not overwrite. It's pretty flexible IMO.
On Thu, Nov 24, 2011 at 6:15 AM, Uma Maheswara Rao G <[email protected]>wrote: > Why con't you use distcp command here? > > Regards, > Uma > ________________________________________ > From: arindam choudhury [[email protected]] > Sent: Thursday, November 24, 2011 4:38 PM > To: [email protected] > Subject: Copying data between Hadoop > > HI, > > I want to copy some files from one HDFS to another. is it possible to do it > split by split like split a1 from node a go to node b? > > -Arindam > -- Linden Hillenbrand Customer Operations Engineer Phone: 650.644.3900 x4946 Email: [email protected] Twitter: @lhillenbrand Data: http://www.cloudera.com
