Re: Utility to push data into HDFS

2015-10-31 Thread Chris Nauroth
Hello Shashi, Maybe I'm missing some context, but are the Hadoop FsShell commands sufficient? http://hadoop.apache.org/docs/r2.7.1/hadoop-project-dist/hadoop-common/FileSystemShell.html These commands work on both *nix and Windows. Another option would be WebHDFS, which just requires an HTTP cl

Re: Utility to push data into HDFS

2015-11-01 Thread Shashi Vishwakarma
Hi Chris, Thanks for your reply. I agree WebHDFS is one of the option to access hadoop from windows or *nix. I wanted to know if I can write a java code will can be executed from windows? Ex: java HDFSPut.java <<- this java code should have FSShell cammand (hadoop fs -ls) written in java. In o

Re: Utility to push data into HDFS

2015-11-01 Thread James Bond
I am guessing this should work - https://stackoverflow.com/questions/9722257/building-jar-that-includes-all-its-dependencies On Sun, Nov 1, 2015 at 8:15 PM, Shashi Vishwakarma wrote: > Hi Chris, > > Thanks for your reply. I agree WebHDFS is one of the option to access > hadoop from windows or *

Re: Utility to push data into HDFS

2015-11-01 Thread Chris Nauroth
Bond mailto:bond.b...@gmail.com>> Reply-To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>" mailto:user@hadoop.apache.org>> Date: Sunday, November 1, 2015 at 9:35 AM To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>" mailto:user@hadoop.ap

RE: Utility to push data into HDFS

2015-11-01 Thread Naganarasimha G R (Naga)
), required in the remote machine ? AFAIK its not required, correct me if i am wrong ! + Naga From: Chris Nauroth [cnaur...@hortonworks.com] Sent: Monday, November 02, 2015 02:10 To: user@hadoop.apache.org Subject: Re: Utility to push data into HDFS In addition to

Re: Utility to push data into HDFS

2015-11-01 Thread Shashi Vishwakarma
Naga > > > -- > > *From:* Chris Nauroth [cnaur...@hortonworks.com] > *Sent:* Monday, November 02, 2015 02:10 > *To:* user@hadoop.apache.org > > *Subject:* Re: Utility to push data into HDFS > > In addition to the standard Hadoop jars ava

RE: Utility to push data into HDFS

2015-11-02 Thread andreina j
In, out, 1024); } } Note: Change the paths mentioned above accordingly Regards, Andreina J. From: Shashi Vishwakarma [mailto:shashi.vish...@gmail.com] Sent: 02 November 2015 PM 01:18 To: user@hadoop.apache.org Subject: Re: Utility to push data into HDFS Hi Naga

Re: Utility to push data into HDFS

2015-11-02 Thread Shashi Vishwakarma
FileInputStream fIn = new FileInputStream(localFile); > > IOUtils.copyBytes(fIn, out, 1024); > > } > > > > } > > Note: Change the paths mentioned above accordingly > > > > Regards, > > Andreina J. >

RE: Utility to push data into HDFS

2015-11-02 Thread Vinayakumar B
ish...@gmail.com<mailto:shashi.vish...@gmail.com>] Sent: 02 November 2015 PM 01:18 To: user@hadoop.apache.org<mailto:user@hadoop.apache.org> Subject: Re: Utility to push data into HDFS Hi Naga and Chris, Yes you are right. I don't have hadoop installed on my windows machine

RE: Utility to push data into HDFS

2015-11-03 Thread Shashi Vishwakarma
path of your client program. > > > > -Vinay > > > > *From:* Shashi Vishwakarma [mailto:shashi.vish...@gmail.com] > *Sent:* Monday, November 02, 2015 10:47 PM > *To:* user@hadoop.apache.org > *Subject:* Re: Utility to push data into HDFS > > > > Hi Andrein

Re: Utility to push data into HDFS

2015-11-04 Thread Vinayakumar B
eros.principal" >> >> >> >>Also you need to keep this directory ( yes, directory itself, not >> files inside it) in class path of your client program. >> >> >> >> -Vinay >> >> >> >> *From:* Shashi Vishwakarma [mai