[
https://issues.apache.org/jira/browse/TEZ-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17503138#comment-17503138
]
Thomas Graves commented on TEZ-3362:
------------------------------------
[~jeagles] [~kshukla] I know its been a while, I was looking at this feature
and I'm wondering how this works on a secure yarn setup? Generally the files
and directories are read/write by the user and read only by the Hadoop group.
If this runs in the auxiliary shuffle handler in the node manager it wouldn't
have permissions to remove the directories.
Is this somehow relying on other permission or configuration changes or is it
running the remove as the user and I'm not seeing it?
> Delete intermediate data at DAG level for Shuffle Handler
> ---------------------------------------------------------
>
> Key: TEZ-3362
> URL: https://issues.apache.org/jira/browse/TEZ-3362
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Jonathan Turner Eagles
> Assignee: Kuhu Shukla
> Priority: Major
> Fix For: 0.9.0
>
> Attachments: TEZ-3362.001.patch, TEZ-3362.002.patch,
> TEZ-3362.003.patch, TEZ-3362.004.patch, TEZ-3362.005.patch,
> TEZ-3362.006.patch, TEZ-3362.007.patch, TEZ-3362.008.patch
>
>
> Applications like hive that use tez in session mode need the ability to
> delete intermediate data after a DAG completes and while the application
> continues to run.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
