[
https://issues.apache.org/jira/browse/TEZ-693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988783#comment-13988783
]
Hitesh Shah commented on TEZ-693:
---------------------------------
[~kamrul] The client/user code could have its own staging dir and data for its
own purposes. The purpose of this jira is to ensure that any data
uploaded/written by the Tez code ( i.e TezClient or AM ) should be deleted by
the framework on app completion. We obviously cannot rely on the TezClient code
doing any cleanup given that the client could be a fire-n-forget hence all the
cleanup work needs to be done in the AM on the final attempt ( or on dag
completion ).
> Deletion of DAG specific data after DAG completion
> --------------------------------------------------
>
> Key: TEZ-693
> URL: https://issues.apache.org/jira/browse/TEZ-693
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Bikas Saha
>
> Currently the client uploads some dag specific data to a remote directory
> specified by the user. The burden is on the client to clean this data after
> the dag completes. The post dag completion code in the AM should be able to
> clean this custom uploaded data.
--
This message was sent by Atlassian JIRA
(v6.2#6252)