Re: The reduce copier failed

2014-03-25 Thread Mahmood Naderan
: attempt_201403212248_0002_r_00_0, Status : FAILED java.io.IOException: Task: attempt_201403212248_0002_r_00_0 - The reduce copier failed     at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:390)     at org.apache.hadoop.mapred.Child$4.run(Child.java:255

Re: The reduce copier failed

2014-03-22 Thread Mahmood Naderan
mapred.JobClient:  map 20% reduce 6% 14/03/22 16:55:13 INFO mapred.JobClient: Task Id : attempt_201403212248_0002_r_00_0, Status : FAILED java.io.IOException: Task: attempt_201403212248_0002_r_00_0 - The reduce copier failed     at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:390

Re: The reduce copier failed

2014-03-21 Thread Mahmood Naderan
How can I find the reason on why the reduce copier failed?   Regards, Mahmood On Thursday, March 20, 2014 12:17 PM, Harsh J ha...@cloudera.com wrote: At the end it says clearly that the job has failed. On Thu, Mar 20, 2014 at 12:49 PM, Mahmood Naderan nt_mahm...@yahoo.com wrote: After

Re: The reduce copier failed

2014-03-21 Thread shashwat shriparv
​Check if the tmp dir, hdfs remaining or log directory are getting filled up while this job runs..​ On Fri, Mar 21, 2014 at 12:11 PM, Mahmood Naderan nt_mahm...@yahoo.comwrote: that imply a *retry* process? Or I have to be wo ​ *Warm Regards_**∞_* * Shashwat Shriparv* [image:

Re: The reduce copier failed

2014-03-21 Thread Mahmood Naderan
OK it seems that there was a free disk space issue. I made more spaces and running again.   Regards, Mahmood On Friday, March 21, 2014 11:43 AM, shashwat shriparv dwivedishash...@gmail.com wrote: ​Check if the tmp dir, hdfs remaining or log directory are getting filled up while this job

Re: The reduce copier failed

2014-03-21 Thread Mahmood Naderan
Again I got the same error and it says The reducer copier failed ... could not find any valid local directory for file /tmp/hadoop-hadoop/map_150.out Searching the web shows that I have to clean up the /tmp/hadoop-hadoop folder but the total size of this folder is 800KB with 1100 files.

Re: The reduce copier failed

2014-03-20 Thread Mahmood Naderan
, then this may have been a transient issue. Worth investigating either way. On Thu, Mar 20, 2014 at 12:57 AM, Mahmood Naderan nt_mahm...@yahoo.com wrote: Hi In the middle of a map-reduce job I get map 20% reduce 6% ... The reduce copier failed map 20% reduce 0% map 20% reduce 1% map 20% reduce 2

Re: The reduce copier failed

2014-03-20 Thread Harsh J
...@yahoo.com wrote: Hi In the middle of a map-reduce job I get map 20% reduce 6% ... The reduce copier failed map 20% reduce 0% map 20% reduce 1% map 20% reduce 2% map 20% reduce 3% Does that imply a *retry* process? Or I have to be worried about that message? Regards, Mahmood

The reduce copier failed

2014-03-19 Thread Mahmood Naderan
Hi In the middle of a map-reduce job I get map 20% reduce 6% ... The reduce copier failed map 20% reduce 0% map 20% reduce 1% map 20% reduce 2% map 20% reduce 3%   Does that imply a *retry* process? Or I have to be worried about that message? Regards, Mahmood

Re: The reduce copier failed

2014-03-19 Thread Harsh J
nt_mahm...@yahoo.com wrote: Hi In the middle of a map-reduce job I get map 20% reduce 6% ... The reduce copier failed map 20% reduce 0% map 20% reduce 1% map 20% reduce 2% map 20% reduce 3% Does that imply a *retry* process? Or I have to be worried about that message? Regards

Re: The reduce copier failed

2008-09-26 Thread Arun C Murthy
copier failed at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:255) at org.apache.hadoop.mapred.TaskTracker $Child.main(TaskTracker.java:2209) Thanks, Joe

The reduce copier failed

2008-09-25 Thread Joe Shaw
: Task Id : attempt_200809180916_0027_r_07_2, Status : FAILED java.io.IOException: attempt_200809180916_0027_r_07_2The reduce copier failed at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:255) at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2209

Re: The reduce copier failed

2008-09-25 Thread Arun C Murthy
reduce copier failed at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:255) at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java: 2209) and eventually failing. The output from hadoop job -history gives me: Task Summary KindTotal

Re: The reduce copier failed

2008-09-25 Thread Joe Shaw
org.apache.hadoop.mapred.ReduceTask: Closed ram manager 2008-09-25 17:12:19,228 WARN org.apache.hadoop.mapred.TaskTracker: Error running child java.io.IOException: attempt_200809180916_0027_r_07_2The reduce copier failed at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:255

Re: The reduce copier failed

2008-09-25 Thread Joe Shaw
attempt_200809180916_0027_m_09_0 2008-09-25 17:12:19,226 INFO org.apache.hadoop.mapred.ReduceTask: Closed ram manager 2008-09-25 17:12:19,228 WARN org.apache.hadoop.mapred.TaskTracker: Error running child java.io.IOException: attempt_200809180916_0027_r_07_2The reduce copier failed

0.15.3 on ec2 - using manual hadoop install no to ec2 magic: The reduce copier failed

2008-02-25 Thread Jason Venner
All of the test/sample jobs fail with either out of memory or The reduce copier failed. Anyone have any tips on this? Our non ec2 installations seem to work just fine. -- Jason Venner Attributor - Publish with Confidence http://www.attributor.com/ Attributor is hiring Hadoop Wranglers, contact