[
https://issues.apache.org/jira/browse/HADOOP-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Devaraj Das updated HADOOP-1042:
--------------------------------
Attachment: 1042.new.patch
Ok, this patch incorporates David's comment (replaced only one line with what
David suggested since that was the only place where such a thing was done).
Actually, there are lots of places in the codebase where similar warnings can
be removed.
> Improve the handling of failed map output fetches
> -------------------------------------------------
>
> Key: HADOOP-1042
> URL: https://issues.apache.org/jira/browse/HADOOP-1042
> Project: Hadoop
> Issue Type: Improvement
> Components: mapred
> Affects Versions: 0.11.2
> Reporter: Devaraj Das
> Assigned To: Devaraj Das
> Attachments: 1042.new.patch, 1042.patch
>
>
> Currently, whenever fetch of a map output fails the corresponding
> MapOutputLocation is added to a List datastructure for later retrial. But, if
> the failure was due to a lost task, the entry that was added is not deleted.
> For such cases, unnecessary retrials will happen. This situation should be
> prevented.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
