[ 
https://issues.apache.org/jira/browse/YARN-661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698518#comment-13698518
 ] 

Omkar Vinit Joshi commented on YARN-661:
----------------------------------------

* First part..very much straight forward.. container-executor.c already had 
some code to do this ...just modified 
ResourceLocalizationService.cleanUpFilesFromSubDir to trigger it. (basically 
swapping subDir with baseDir )...
* I am exposing deletion task dependency to user via DeletionService. Now user 
can specify multilevel deletion task DAG and deletion service will take care of 
it one all parent (root) deletion tasks are started by user after defining 
dependency.
I tested this locally on secured cluster.. but will add test cases to verify 
that DAG actually works. I will update patch with test cases attaching initial 
patch.

                
> NM fails to cleanup local directories for users
> -----------------------------------------------
>
>                 Key: YARN-661
>                 URL: https://issues.apache.org/jira/browse/YARN-661
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 2.1.0-beta, 0.23.8
>            Reporter: Jason Lowe
>            Assignee: Omkar Vinit Joshi
>         Attachments: YARN-661-20130701.patch
>
>
> YARN-71 added deletion of local directories on startup, but in practice it 
> fails to delete the directories because of permission problems.  The 
> top-level usercache directory is owned by the user but is in a directory that 
> is not writable by the user.  Therefore the deletion of the user's usercache 
> directory, as the user, fails due to lack of permissions.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to