The non-existence of the job.xml file causes a LOT of tasks of the job fail
---------------------------------------------------------------------------
Key: HADOOP-810
URL: http://issues.apache.org/jira/browse/HADOOP-810
Project: Hadoop
Issue Type: Bug
Reporter: Runping Qi
For some reason, the job.xml file disappears from one of the nodes. That causes
the following exception:
java.lang.RuntimeException: java.lang.RuntimeException:
taskTracker/jobcache/job_0039/job.xml not found
at
org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:551)
at
org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:472)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:453)
at org.apache.hadoop.conf.Configuration.get(Configuration.java:201)
at
org.apache.hadoop.conf.Configuration.getBoolean(Configuration.java:286)
at
org.apache.hadoop.mapred.JobConf.getKeepFailedTaskFiles(JobConf.java:212)
at
org.apache.hadoop.mapred.TaskTracker$TaskInProgress.setJobConf(TaskTracker.java:874)
at
org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:313)
at
org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:307)
at
org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:691)
at
org.apache.hadoop.mapred.TaskTracker.checkForNewTasks(TaskTracker.java:533)
at
org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:448)
at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:720)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1374)
That is fine by itself.
The problem is the task tracker keeps accepting tasks of the same job, and
keeps failing them!
The correct behavior is that it either tries to get the job.xml from the job
tracker, or refuses accepting any new tasks
of the same job.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
