[
https://issues.apache.org/jira/browse/TEZ-693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13991187#comment-13991187
]
Hitesh Shah commented on TEZ-693:
---------------------------------
bq. Remove these files in RecoveryService.serviceStop()
- Incorrect. This needs to be done only on the last attempt. Service stop
will be called on each attempt.
bq. Client has to remove this file at the end. ( for
$STAGE_DIR/tez-conf.pb.APP_ID,
$STAGE_DIR/tez.session.local-resources.pb.file-name.APP_ID,
$STAGE_DIR/tez-dag.pb.APP_ID, $STAGE_DIR/tez-dag.pb.txtAPP_ID )
- Clean up should be done by AM and not client. Refer to previous comments on
why we cannot rely on the client.
> Deletion of DAG specific data after DAG completion
> --------------------------------------------------
>
> Key: TEZ-693
> URL: https://issues.apache.org/jira/browse/TEZ-693
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Bikas Saha
> Assignee: Mohammad Kamrul Islam
>
> Currently the client uploads some dag specific data to a remote directory
> specified by the user. The burden is on the client to clean this data after
> the dag completes. The post dag completion code in the AM should be able to
> clean this custom uploaded data.
--
This message was sent by Atlassian JIRA
(v6.2#6252)