[
https://issues.apache.org/jira/browse/MAPREDUCE-5641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138124#comment-16138124
]
zhangyubiao edited comment on MAPREDUCE-5641 at 8/23/17 9:21 AM:
-----------------------------------------------------------------
Though timelineserver show the application history but the killjob
hdfs://user/readuser//.staging/job_XXXXXXXXXX_XXXX still left in the fold.
So we can deal with this in the applicationhistory or deal it in a split thread
with RM ? [~zjshen]
was (Author: piaoyu zhang):
Though timelineserver show the application history but the killjob
hdfs://user/readuser//.staging/job_1496915015540_XXXX still left in the fold.
So we can deal with this in the applicationhistory or deal it in a split
thread with RM ? [~zjshen]
> History for failed Application Masters should be made available to the Job
> History Server
> -----------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-5641
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5641
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: applicationmaster, jobhistoryserver
> Affects Versions: 2.2.0
> Reporter: Robert Kanter
> Attachments: MAPREDUCE-5641.patch, MAPREDUCE-5641.patch
>
>
> Currently, the JHS has no information about jobs whose AMs have failed. This
> is because the History is written by the AM to the intermediate folder just
> before finishing, so when it fails for any reason, this information isn't
> copied there. However, it is not lost as its in the AM's staging directory.
> To make the History available in the JHS, all we need to do is have another
> mechanism to move the History from the staging directory to the intermediate
> directory. The AM also writes a "Summary" file before exiting normally,
> which is also unavailable when the AM fails.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
