copyToLocal (from Amazon AWS)
Hi, I am not sure if this question has been asked. Its more of a hadoop fs question. I am trying to execute the following hadoop fs command : hadoop fs -copyToLocal s3n://:@/file.txt /home/hadoop/workspace/file.txt When I execute this command directly from the Terminal shell, it works perfectly fine, however the above command from code doesn't execute. In fact, it says : Exception in thread "main" copyToLocal: null Please note I am using Runtime.getRunTime().exec(cmdStr), where cmdStr is the above hadoop command. Also, please note that hadoop fs -cp or hadoop fs -rmr commands work fine with source and destination being both Amazon AWS locations. In the above command (hadoop fs -copyToLocal) the destination is local location to my machine(Ubuntu installed). Your help would be greatly appreciated. Thanks, Neeral
Re: copyToLocal (from Amazon AWS)
try using complete path for where you hadoop binary is present. For eg /usr/bin/hadoop instead of hadoop... On Tue, May 31, 2011 at 3:56 PM, neeral beladia wrote: > Hi, > > I am not sure if this question has been asked. Its more of a hadoop fs > question. I am trying to execute the following hadoop fs command : > > hadoop fs -copyToLocal s3n://:@ name>/file.txt /home/hadoop/workspace/file.txt > > When I execute this command directly from the Terminal shell, it works > perfectly fine, however the above command from code doesn't execute. In > fact, > it says : > > Exception in thread "main" copyToLocal: null > > Please note I am using Runtime.getRunTime().exec(cmdStr), where cmdStr is > the > above hadoop command. Also, please note that hadoop fs -cp or hadoop fs > -rmr > commands work fine with source and destination being both Amazon AWS > locations. > In the above command (hadoop fs -copyToLocal) the destination is local > location > to my machine(Ubuntu installed). > > Your help would be greatly appreciated. > > Thanks, > > Neeral
Re: copyToLocal (from Amazon AWS)
Oops.. reading again, the command is working. what is the exact string that you have in cmdStr ? On Tue, May 31, 2011 at 4:51 PM, Mapred Learn wrote: > try using complete path for where you hadoop binary is present. For eg > /usr/bin/hadoop instead of hadoop... > > > > On Tue, May 31, 2011 at 3:56 PM, neeral beladia > wrote: > >> Hi, >> >> I am not sure if this question has been asked. Its more of a hadoop fs >> question. I am trying to execute the following hadoop fs command : >> >> hadoop fs -copyToLocal s3n://:@> name>/file.txt /home/hadoop/workspace/file.txt >> >> When I execute this command directly from the Terminal shell, it works >> perfectly fine, however the above command from code doesn't execute. In >> fact, >> it says : >> >> Exception in thread "main" copyToLocal: null >> >> Please note I am using Runtime.getRunTime().exec(cmdStr), where cmdStr is >> the >> above hadoop command. Also, please note that hadoop fs -cp or hadoop fs >> -rmr >> commands work fine with source and destination being both Amazon AWS >> locations. >> In the above command (hadoop fs -copyToLocal) the destination is local >> location >> to my machine(Ubuntu installed). >> >> Your help would be greatly appreciated. >> >> Thanks, >> >> Neeral > > >