Re: Lost tasktracker errors

2013-01-04 Thread Robert Evans
This really should be on the user list so I am moving it over there. It is probably something about the OS that is killing it. The only thing that I know of on stock Linux that would do this is the Out of Memory Killer. Do you have swap enabled on these boxes? You should check the OOM killer lo

Re: Distscp code

2013-01-04 Thread Dave Beech
org.apache.hadoop.tools.DistCp Cheers, Dave On 4 January 2013 11:47, Kasi Subrahmanyam wrote: > Hi Guys, > > The FsShell class has the code that runs behind for normal operations that > we perform on HDFS. > Which classs has the code for distscp? >

Re: Streaming Job map/reduce not working with scripts on 1.0.3

2013-01-04 Thread Ben Kim
nevermind. the problem has been fixed. The problem was the trailing {control-v}{control-m} character on the first line of #!/bin/bash (which i blame my teammate for writing the script in windows notepad !!) On Fri, Jan 4, 2013 at 8:09 PM, Ben Kim wrote: > Hi ! > > I'm using hadoop-1.0.3 to

Streaming Job map/reduce not working with scripts on 1.0.3

2013-01-04 Thread Ben Kim
Hi ! I'm using hadoop-1.0.3 to run streaming jobs with map/reduce shell scripts such as this bin/hadoop jar ./contrib/streaming/hadoop-streaming-1.0.3.jar -input /input -output /output/015 -mapper "streaming-map.sh" -reducer "streaming-reduce.sh" -file /home/hadoop/streaming/streaming-map.sh -fil