[
https://issues.apache.org/jira/browse/TEZ-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14039912#comment-14039912
]
Hitesh Shah commented on TEZ-1216:
----------------------------------
bq. Q1. We were not sure about condition 2(B). Some failure case will not be
retired. The question is how to determine that?
- there are 2 reasons the AM will not be relaunched. One if it is the last
attempt. Second if it unregisters with the RM. It can unregister with any
status - succeeded/failed, etc. We need to handle both these cases.
bq. Q2. Is there a good place to host this new function in DAGppMaster? You
mentioned shutdownTezAM() is not a good place because it called in every
attempt.
- Something like what the MR AM does should work. One thing to note is that
serviceStop() may not be called if serviceStart() is not invoked. For a
scenario, in the last attempt, when the AM shutdown is invoked before it fully
started, this may end up being an issue. You can also probably look at the
shutdown hooks to see if something could be done there.
> Clean up the staging directory when the application completes
> -------------------------------------------------------------
>
> Key: TEZ-1216
> URL: https://issues.apache.org/jira/browse/TEZ-1216
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Mohammad Kamrul Islam
> Assignee: Mohammad Kamrul Islam
>
> This JIRA is a part of TEZ-693. It includes the removal of stage directory
> when application's last attempt is done. In addition, it will check a config
> to determine whether to auto clean it or not.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
