Task startup fail when localizeTask directory is full -----------------------------------------------------
Key: HADOOP-1991 URL: https://issues.apache.org/jira/browse/HADOOP-1991 Project: Hadoop Issue Type: Bug Components: mapred Reporter: Koji Noguchi Priority: Minor Fix For: 0.16.0 We had a job filling up one particular drive (different bug) that resulted in all the subsequent tasks on that node to fail with java.io.IOException: Mkdirs failed to create /vol2/mapred-tt/mapred-local/taskTracker/jobcache/job_200710030011_0001/task_200710030011_0001_m_007363_0 at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:1284) at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:1344) at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:647) at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:640) at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1167) at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:832) at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:1203) at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1888) It'll be nice if localization also uses localdirallocator to utilize multiple disks. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.