This is from your mapred.local.dir (which by default may reuse hadoop.tmp.dir).
Do you see free space available when you do the following?: df -h /opt/hadoop On Thu, Apr 26, 2012 at 12:43 AM, Nuthalapati, Ramesh <ramesh.nuthalap...@mtvstaff.com> wrote: > Strangely isee the tmp folder has enough space. What else could be the > problem ? How much should my tmp space be ? > > > Error: java.io.IOException: No space left on device > at java.io.FileOutputStream.writeBytes(Native Method) > at java.io.FileOutputStream.write(FileOutputStream.java:260) > at > org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.write(RawLocalFileSystem.java:190) > at > java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65) > at java.io.BufferedOutputStream.write(BufferedOutputStream.java:109) > at > org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:49) > at java.io.DataOutputStream.write(DataOutputStream.java:90) > at > org.apache.hadoop.mapred.IFileOutputStream.write(IFileOutputStream.java:84) > at > org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:49) > at java.io.DataOutputStream.write(DataOutputStream.java:90) > at org.apache.hadoop.mapred.IFile$Writer.append(IFile.java:218) > at org.apache.hadoop.mapred.Merger.writeFile(Merger.java:157) > at > org.apache.hadoop.mapred.ReduceTask$ReduceCopier$LocalFSMerger.run(ReduceTask.java:2454) > > java.io.IOException: Task: attempt_201204240741_0003_r_000000_1 - The reduce > copier failed > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:380) > at org.apache.hadoop.mapred.Child.main(Child.java:170) > Caused by: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not > find any valid local directory for > file:/opt/hadoop/tmp/hadoop-hadoop/mapred/local/taskTracker/jobcache/job_201204240741_0003/attempt_201204240741_0003_r_000000_1/output/map_122.out > at > org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:343) > at > org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:124) > at > org.apache.hadoop.mapred.ReduceTask$ReduceCopier$LocalFSMerger.run(ReduceTask.java:2434) > > -- Harsh J
