This really should be on the user list so I am moving it over there.
It is probably something about the OS that is killing it. The only thing
that I know of on stock Linux that would do this is the Out of Memory
Killer. Do you have swap enabled on these boxes? You should check the
OOM killer lo
org.apache.hadoop.tools.DistCp
Cheers,
Dave
On 4 January 2013 11:47, Kasi Subrahmanyam wrote:
> Hi Guys,
>
> The FsShell class has the code that runs behind for normal operations that
> we perform on HDFS.
> Which classs has the code for distscp?
>
nevermind. the problem has been fixed.
The problem was the trailing {control-v}{control-m} character on the first
line of #!/bin/bash
(which i blame my teammate for writing the script in windows notepad !!)
On Fri, Jan 4, 2013 at 8:09 PM, Ben Kim wrote:
> Hi !
>
> I'm using hadoop-1.0.3 to
Hi !
I'm using hadoop-1.0.3 to run streaming jobs with map/reduce shell scripts
such as this
bin/hadoop jar ./contrib/streaming/hadoop-streaming-1.0.3.jar -input /input
-output /output/015 -mapper "streaming-map.sh" -reducer
"streaming-reduce.sh" -file /home/hadoop/streaming/streaming-map.sh -fil