[ 
https://issues.apache.org/jira/browse/MAPREDUCE-4342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13296019#comment-13296019
 ] 

Mayank Bansal commented on MAPREDUCE-4342:
------------------------------------------

Problem is DC maintains a Tree map based on the 
Key => file path on hdfs + time + Tracker machine name
Value => actual path of cache on task tracker machine

If because of some reason actual path gets deleted from the machine , 
distributed cache thinks it still have the file and returns the inconsistent 
results because of that user code fails.

It is a DC responsibility to provide the consistent result. 

                
> Distributed Cache gives inconsistent result if cache files get deleted from 
> task tracker 
> -----------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-4342
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4342
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 0.22.0, 1.0.3, trunk
>            Reporter: Mayank Bansal
>            Assignee: Mayank Bansal
>         Attachments: MAPREDUCE-4342-22.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to