[ https://issues.apache.org/jira/browse/MAPREDUCE-5641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13901887#comment-13901887 ]
Alejandro Abdelnur commented on MAPREDUCE-5641: ----------------------------------------------- [~rkanter], [~jlowe], how about not touching the current permissions of stating and making the RM a proxy user in HDFS. Then the files would be written as the user. [~vinodkv], I'm a bit reluctant to get the JHS to depend on the AHS at this point as the AHS is not fully cooked. I would prefer dropping the JHS alltogether in favor of the AHS when the AHS is ready for prime time with AM extensions. > History for failed Application Masters should be made available to the Job > History Server > ----------------------------------------------------------------------------------------- > > Key: MAPREDUCE-5641 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5641 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: applicationmaster, jobhistoryserver > Affects Versions: 2.2.0 > Reporter: Robert Kanter > Assignee: Robert Kanter > Attachments: MAPREDUCE-5641.patch > > > Currently, the JHS has no information about jobs whose AMs have failed. This > is because the History is written by the AM to the intermediate folder just > before finishing, so when it fails for any reason, this information isn't > copied there. However, it is not lost as its in the AM's staging directory. > To make the History available in the JHS, all we need to do is have another > mechanism to move the History from the staging directory to the intermediate > directory. The AM also writes a "Summary" file before exiting normally, > which is also unavailable when the AM fails. -- This message was sent by Atlassian JIRA (v6.1.5#6160)