Re: Could not find any valid local directory for task

2008-08-03 Thread Amareshwari Sriramadasu
The error "Could not find any valid local directory for task" means that 
the task could not find a local directory to write file, mostly because 
there is no enough space on any of the disks.


Thanks
Amareshwari

Shirley Cohen wrote:

Hi,

Does anyone know what the following error means?

hadoop-0.16.4/logs/userlogs/task_200808021906_0002_m_14_2]$ cat 
syslog
2008-08-02 20:28:00,443 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: 
Initializing JVM Metrics with processName=MAP, sessionId=
2008-08-02 20:28:00,684 INFO org.apache.hadoop.mapred.MapTask: 
numReduceTasks: 15
2008-08-02 20:30:08,594 WARN org.apache.hadoop.mapred.TaskTracker: 
Error running child

java.io.IOException
at 
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:719)

at org.apache.hadoop.mapred.MapTask.run(MapTask.java:209)
at 
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
Caused by: org.apache.hadoop.util.DiskChecker$DiskErrorException: 
Could not find any valid local directory for 
task_200808021906_0002_m_14_2/spill4.out


Please let me know if you need more information about my setup.

Thanks in advance,

Shirley




Could not find any valid local directory for task

2008-08-03 Thread Shirley Cohen

Hi,

Does anyone know what the following error means?

hadoop-0.16.4/logs/userlogs/task_200808021906_0002_m_14_2]$ cat  
syslog
2008-08-02 20:28:00,443 INFO  
org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics  
with processName=MAP, sessionId=
2008-08-02 20:28:00,684 INFO org.apache.hadoop.mapred.MapTask:  
numReduceTasks: 15
2008-08-02 20:30:08,594 WARN org.apache.hadoop.mapred.TaskTracker:  
Error running child

java.io.IOException
at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush 
(MapTask.java:719)

at org.apache.hadoop.mapred.MapTask.run(MapTask.java:209)
at org.apache.hadoop.mapred.TaskTracker$Child.main 
(TaskTracker.java:2084)
Caused by: org.apache.hadoop.util.DiskChecker$DiskErrorException:  
Could not find any valid local directory for  
task_200808021906_0002_m_14_2/spill4.out


Please let me know if you need more information about my setup.

Thanks in advance,

Shirley