Mikhail Yakshin wrote:
On Wed, Sep 24, 2008 at 9:24 PM, Elia Mazzawi wrote:
I got these errors I don't know what they mean, any help is appreciated.
I suspect that either its a H/W error or the cluster is out of space to
store intermediate results?
there is still lots of free space left on the cluster.
08/09/24 00:23:31 INFO mapred.JobClient: map 79% reduce 24%
08/09/24 00:24:53 INFO mapred.JobClient: map 80% reduce 24%
08/09/24 00:26:28 INFO mapred.JobClient: map 80% reduce 0%
08/09/24 00:26:28 INFO mapred.JobClient: Task Id :
task_200809041356_0037_r_000000_2, Status : FAILED
java.io.IOException: task_200809041356_0037_r_000000_2The reduce copier
failed
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:329)
at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
Nope. In fact, it could be much more complicated as it gets %)
Several possible causes of this error, as far as I know:
* An error in partitioner (for example, look out for negative keys and
default "key % numReducers" algorithm - strange Java modulo operator
(%) yields negative values for negative keys, thus effectively sending
output to non-existing reducers).
* An error in group/key/value comparator.
I only had 1 reducer running.
you think it is possibly a bug in my reducer code?
