I got these errors I don't know what they mean, any help is appreciated.
I suspect that either its a H/W error or the cluster is out of space to store intermediate results?
there is still lots of free space left on the cluster.


08/09/24 00:23:31 INFO mapred.JobClient:  map 79% reduce 24%
08/09/24 00:24:53 INFO mapred.JobClient:  map 80% reduce 24%
08/09/24 00:26:28 INFO mapred.JobClient:  map 80% reduce 0%
08/09/24 00:26:28 INFO mapred.JobClient: Task Id : task_200809041356_0037_r_000000_2, Status : FAILED java.io.IOException: task_200809041356_0037_r_000000_2The reduce copier failed
       at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:329)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)

08/09/24 00:27:30 INFO mapred.JobClient:  map 80% reduce 1%
08/09/24 00:28:34 INFO mapred.JobClient:  map 80% reduce 2%
08/09/24 00:29:38 INFO mapred.JobClient:  map 80% reduce 3%
08/09/24 00:31:04 INFO mapred.JobClient:  map 80% reduce 4%
08/09/24 00:32:21 INFO mapred.JobClient:  map 80% reduce 5%
08/09/24 00:33:47 INFO mapred.JobClient:  map 80% reduce 6%
08/09/24 00:35:12 INFO mapred.JobClient:  map 80% reduce 7%
08/09/24 00:36:19 INFO mapred.JobClient:  map 80% reduce 8%
08/09/24 00:37:58 INFO mapred.JobClient:  map 80% reduce 9%
08/09/24 00:39:17 INFO mapred.JobClient:  map 80% reduce 10%
08/09/24 00:40:43 INFO mapred.JobClient:  map 80% reduce 11%
08/09/24 00:42:01 INFO mapred.JobClient:  map 80% reduce 12%
08/09/24 00:43:27 INFO mapred.JobClient:  map 80% reduce 13%
08/09/24 00:44:35 INFO mapred.JobClient:  map 80% reduce 14%
08/09/24 00:45:40 INFO mapred.JobClient:  map 80% reduce 15%
08/09/24 00:46:38 INFO mapred.JobClient:  map 80% reduce 16%
08/09/24 00:47:32 INFO mapred.JobClient:  map 80% reduce 17%
08/09/24 00:49:44 INFO mapred.JobClient:  map 100% reduce 82%
java.io.IOException: Job failed!
       at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1062)
       at org.myorg.binAnalysis.main(binAnalysis.java:91)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:585)
       at org.apache.hadoop.util.RunJar.main(RunJar.java:155)
       at org.apache.hadoop.mapred.JobShell.run(JobShell.java:194)
       at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
       at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
       at org.apache.hadoop.mapred.JobShell.main(JobShell.java:220)


Reply via email to