Reducer hanging in copyOutput
------------------------------
Key: HADOOP-1670
URL: https://issues.apache.org/jira/browse/HADOOP-1670
Project: Hadoop
Issue Type: Bug
Components: mapred
Affects Versions: 0.13.0
Reporter: Koji Noguchi
Priority: Minor
A host with one of the drives 100% full, reducer was hanging, repeating the
following warnings.
2007-08-01 15:56:33,386 WARN org.apache.hadoop.mapred.ReduceTask:
java.io.IOException: df: `/tmp3/mapred-local': No such file or directory
at org.apache.hadoop.fs.DF.doDF(DF.java:64)
at org.apache.hadoop.fs.DF.<init>(DF.java:53)
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:181)
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:218)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:124)
at
org.apache.hadoop.mapred.MapOutputLocation.getFile(MapOutputLocation.java:228)
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:680)
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:641)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
