Trying to figure out what the scenario that would cause the following errors. Since it is logged as INFO I wasn't sure if it was from speculative execution, or if there is something more serious happening. Anyone seen these errors? They occur a lot.
Also, note: We have plenty of disk space on this machine, and we aren't using /tmp - so doesn't seem like the folders would be deleted by a cron job/other. Logs: 2009-05-10 23:58:18,737 INFO org.apache.hadoop.mapred.TaskTracker: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out in any of the configured local directories 2009-05-10 23:58:18,737 INFO org.apache.hadoop.mapred.TaskTracker: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out in any of the configured local directories 2009-05-10 23:58:23,808 INFO org.apache.hadoop.mapred.TaskTracker: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out in any of the configured local directories 2009-05-10 23:58:23,809 INFO org.apache.hadoop.mapred.TaskTracker: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out in any of the configured local directories 2009-05-10 23:58:28,810 INFO org.apache.hadoop.mapred.TaskTracker: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out in any of the configured local directories 2009-05-10 23:58:28,810 INFO org.apache.hadoop.mapred.TaskTracker: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out in any of the configured local directories 2009-05-10 23:58:33,811 INFO org.apache.hadoop.mapred.TaskTracker: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out in any of the configured local directories 2009-05-10 23:58:33,812 INFO org.apache.hadoop.mapred.TaskTracker: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out in any of the configured local directories 2009-05-10 23:58:38,813 INFO org.apache.hadoop.mapred.TaskTracker: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out in any of the configured local directories 2009-05-10 23:58:38,813 INFO org.apache.hadoop.mapred.TaskTracker: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out in any of the configured local directories 2009-05-10 23:58:43,814 INFO org.apache.hadoop.mapred.TaskTracker: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out in any of the configured local directories 2009-05-10 23:58:43,814 INFO org.apache.hadoop.mapred.TaskTracker: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out in any of the configured local directories 2009-05-10 23:58:48,815 INFO org.apache.hadoop.mapred.TaskTracker: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out in any of the configured local directories 2009-05-10 23:58:48,815 INFO org.apache.hadoop.mapred.TaskTracker: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out in any of the configured local directories 2009-05-10 23:58:53,816 INFO org.apache.hadoop.mapred.TaskTracker: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out in any of the configured local directories