[
https://issues.apache.org/jira/browse/MAPREDUCE-947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amar Kamat updated MAPREDUCE-947:
---------------------------------
Release Note: Introduced abortJob() method in OutputCommitter which will be
invoked when the job fails or is killed. By default it invokes
OutputCommitter.cleanupJob(). Deprecated OutputCommitter.cleanupJob() and
introduced OutputCommitter.commitJob() method which will be invoked for
successful jobs. Also a _SUCCESS file is created in the output folder for
successful jobs. (was: Introduced abortJob() method in OutputCommitter which
will be invoked when the job fails or is killed. Also a _done file is created
in the output folder for successful jobs while _abort is created for
failed/killed jobs.)
> OutputCommitter should have an abortJob method
> ----------------------------------------------
>
> Key: MAPREDUCE-947
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-947
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Affects Versions: 0.21.0
> Reporter: Owen O'Malley
> Assignee: Amar Kamat
> Fix For: 0.22.0
>
> Attachments: mapred-948-v1.12-branch-0.20-internal.patch,
> mapred-948-v1.12.patch, mapred-948-v1.13-branch-0.20-internal.patch,
> mapred-948-v1.2.patch, mapred-948-v1.3.patch, mapred-948-v1.4.patch,
> mapred-948-v1.7.patch, mapred-948-v2.1-branch-0.20.patch,
> mapred-948-v2.3-branch-0.20.patch, mapred-948-v2.3.patch,
> mapred-948-v3.1.patch, mapred-948-v3.2.patch, mapred-948-v3.4.patch,
> mr-947-trunk-new.patch, mr-947-trunk-new.patch, mr-947-trunk.patch,
> mr-947-trunk.patch, mr-947-trunk.patch, mr-947-y20-new.patch,
> mr-947-y20.patch, mr-947-y20.patch
>
>
> The OutputCommitter needs an abortJob method to clean up from failed jobs.
> Currently there is no way to distinguish between failed or succeeded jobs,
> making it impossible to write output promotion code.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
