The error "Could not find any valid local directory for task" means that
the task could not find a local directory to write file, mostly because
there is no enough space on any of the disks.
Thanks
Amareshwari
Shirley Cohen wrote:
Hi,
Does anyone know what the following error means?
hadoop-0.16.4/logs/userlogs/task_200808021906_0002_m_14_2]$ cat
syslog
2008-08-02 20:28:00,443 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=MAP, sessionId=
2008-08-02 20:28:00,684 INFO org.apache.hadoop.mapred.MapTask:
numReduceTasks: 15
2008-08-02 20:30:08,594 WARN org.apache.hadoop.mapred.TaskTracker:
Error running child
java.io.IOException
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:719)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:209)
at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
Caused by: org.apache.hadoop.util.DiskChecker$DiskErrorException:
Could not find any valid local directory for
task_200808021906_0002_m_14_2/spill4.out
Please let me know if you need more information about my setup.
Thanks in advance,
Shirley