[ 
https://issues.apache.org/jira/browse/YARN-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13731945#comment-13731945
 ] 

Koji Noguchi commented on YARN-1036:
------------------------------------

When reading MAPREDUCE-4342 initially, I didn't understand why the files were 
deleted in the first place.   Until recently, when we started seeing 
inconsistent distributed cache after we enabled 
Disk-Fail-In-Place(MAPREDUCE-2413).  

NodeManager/TaskTracker keeps on running even after finding bad disks without 
throwing away distributed cache entries coming from those disks resulting in 
incomplete set of distributed cache available to our users.
                
> Distributed Cache gives inconsistent result if cache files get deleted from 
> task tracker 
> -----------------------------------------------------------------------------------------
>
>                 Key: YARN-1036
>                 URL: https://issues.apache.org/jira/browse/YARN-1036
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 0.23.9
>            Reporter: Ravi Prakash
>            Assignee: Ravi Prakash
>         Attachments: YARN-1036.branch-0.23.patch
>
>
> This is a JIRA to backport MAPREDUCE-4342. I had to open a new JIRA because 
> that one had been closed. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to