Reading/Writing files to HDFS from Windwos server

2015-10-31 Thread Vishwakarma, Chhaya
I want to write files to HDFS from windows server. Hadoop cluster is on Linux. I tried researching everywhere I got a java code that can be run using "hadoop jar" Can somebody help me to understand how can I run HDFS file write java code from windows? What is required on Windows box? Even a pro

Re: Utility to push data into HDFS

2015-10-31 Thread Chris Nauroth
Hello Shashi, Maybe I'm missing some context, but are the Hadoop FsShell commands sufficient? http://hadoop.apache.org/docs/r2.7.1/hadoop-project-dist/hadoop-common/FileSystemShell.html These commands work on both *nix and Windows. Another option would be WebHDFS, which just requires an HTTP cl

Utility to push data into HDFS

2015-10-31 Thread Shashi Vishwakarma
Hi I need build a common utility for unix/windows based system to push data into hadoop system. User can run that utility from any platform and should be able to push data into HDFS. Any suggestions ? Thanks Shashi

Re: New to hadoop. Need help

2015-10-31 Thread Tenghuan He
You can see the local location settings in your /etc/hadoop/hdfs.xml files in the property *dfs.namenode.name.dir* for namenode and *dfs.datanode.data.dir* for datanode if you didn't configure these, on Windows 7 it may go to *D:\tmp\hadoop-username\dfs* (in my case, with hadoop installed in *D:\*