[
https://issues.apache.org/jira/browse/HADOOP-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12649592#action_12649592
]
Jothi Padmanabhan commented on HADOOP-4699:
-------------------------------------------
Disregard my previous comment, if we use NIO, we would not be reading the file
at the servlet all and so cannot validate the checksum.
> Change TaskTracker.MapOutputServlet to send only the IFile segment, validate
> checksum in Reduce
> -----------------------------------------------------------------------------------------------
>
> Key: HADOOP-4699
> URL: https://issues.apache.org/jira/browse/HADOOP-4699
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Chris Douglas
> Assignee: Chris Douglas
> Fix For: 0.20.0
>
>
> Instead of validating the checksum of the IFile segment in MapOutputServlet,
> validation may be left to the reduce. While failures may not be detected
> until late in the reduce, the throughput and CPU improvements should make up
> for it in the average case.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
