[
https://issues.apache.org/jira/browse/MAPREDUCE-4342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396093#comment-13396093
]
Mayank Bansal commented on MAPREDUCE-4342:
------------------------------------------
Thanks Robert for the comments. I will fix this message and update the patch
with the test-patch result.
I am investigating it for trunk put the patch soon.
You are correct It will not work if file is been deleted for archive or if the
file gets corrupted but it should work if you want to add new file for your DC
as it checked by Modification Date in HDFS.
I agree with your thoughts about we should think about the prevention itself
then recovery however we may still need to have recovery because there are lots
of variables here and files can be deleted by multiple reasons like Hadoop ops
deleted those files accidentally or some script which has the root permissions
delete that etc.
I am opening two JIRAs one is for archive file and other is for read
permissions and will work on those subsequently.
https://issues.apache.org/jira/browse/MAPREDUCE-4349
https://issues.apache.org/jira/browse/MAPREDUCE-4350
Thanks,
Mayank
> Distributed Cache gives inconsistent result if cache files get deleted from
> task tracker
> -----------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4342
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4342
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.22.0, 1.0.3, trunk
> Reporter: Mayank Bansal
> Assignee: Mayank Bansal
> Attachments: MAPREDUCE-4342-22-1.patch, MAPREDUCE-4342-22.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
