[
https://issues.apache.org/jira/browse/MAPREDUCE-4850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13532426#comment-13532426
]
Alejandro Abdelnur commented on MAPREDUCE-4850:
-----------------------------------------------
+1, i got a bit confused by why we need to do a doAs, but mapred is not an HDFS
superuser, that is way.
> Job recovery may fail if staging directory has been deleted
> -----------------------------------------------------------
>
> Key: MAPREDUCE-4850
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4850
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv1
> Affects Versions: 1.1.1
> Reporter: Tom White
> Assignee: Tom White
> Attachments: MAPREDUCE-4850.patch, MAPREDUCE-4850.patch
>
>
> The job staging directory is deleted in the job cleanup task, which happens
> before the job-info file is deleted from the system directory (by the
> JobInProgress garbageCollect() method). If the JT shuts down between these
> two operations, then when the JT restarts and tries to recover the job, it
> fails since the job.xml and splits are no longer available.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
