So I want to copy the file from windows machine to linux namenode. How can I define NAMENODE_URI in the code you mention, if I want to copy data from windows machine to namenode machine ?
Thanks, Praveenesh On Wed, Sep 21, 2011 at 2:37 PM, Uma Maheswara Rao G 72686 < mahesw...@huawei.com> wrote: > For more understanding the flows, i would recommend you to go through once > below docs > > http://hadoop.apache.org/common/docs/r0.16.4/hdfs_design.html#The+File+System+Namespace > > Regards, > Uma > > ----- Original Message ----- > From: Uma Maheswara Rao G 72686 <mahesw...@huawei.com> > Date: Wednesday, September 21, 2011 2:36 pm > Subject: Re: Any other way to copy to HDFS ? > To: common-user@hadoop.apache.org > > > > > Hi, > > > > You need not copy the files to NameNode. > > > > Hadoop provide Client code as well to copy the files. > > To copy the files from other node ( non dfs), you need to put the > > hadoop**.jar's into classpath and use the below code snippet. > > > > FileSystem fs =new DistributedFileSystem(); > > fs.initialize("NAMENODE_URI", configuration); > > > > fs.copyFromLocal(srcPath, dstPath); > > > > using this API, you can copy the files from any machine. > > > > Regards, > > Uma > > > > > > > > > > > > ----- Original Message ----- > > From: praveenesh kumar <praveen...@gmail.com> > > Date: Wednesday, September 21, 2011 2:14 pm > > Subject: Any other way to copy to HDFS ? > > To: common-user@hadoop.apache.org > > > > > Guys, > > > > > > As far as I know hadoop, I think, to copy the files to HDFS, > > first > > > it needs > > > to be copied to the NameNode's local filesystem. Is it right ?? > > > So does it mean that even if I have a hadoop cluster of 10 nodes > > with> overall capacity of 6TB, but if my NameNode's hard disk > > capacity > > > is 500 GB, > > > I can not copy any file to HDFS greater than 500 GB ? > > > > > > Is there any other way to directly copy to HDFS without copy the > > > file to > > > namenode's local filesystem ? > > > What can be other ways to copy large files greater than > > namenode's > > > diskcapacity ? > > > > > > Thanks, > > > Praveenesh. > > > > > >
