[
https://issues.apache.org/jira/browse/HADOOP-4302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12635549#action_12635549
]
Chris Douglas commented on HADOOP-4302:
---------------------------------------
The test is nondeterministic; though it sets mapred.inmem.merge.threshold to 2,
the third may be fetched, closed, and included in the in-memory merge. In this
case, all the outputs will be merged to disk. The test should probably set
mapred.reduce.parallel.copies to 1 to avoid the race, here. Off-by-n misses on
mapred.inmem.merge.threshold aren't a real bug, not even for the final outputs;
it's a heuristic, not a contract.
> TestReduceFetch fails intermittently
> ------------------------------------
>
> Key: HADOOP-4302
> URL: https://issues.apache.org/jira/browse/HADOOP-4302
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Devaraj Das
> Assignee: Chris Douglas
> Priority: Blocker
> Fix For: 0.19.0
>
> Attachments: 0J5g5b71.html.part
>
>
> I see TestReduceFetch failing once in a while. Here is one such failure
> http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3350/testReport/org.apache.hadoop.mapred/TestReduceFetch/testReduceFromPartialMem/
> Marking this as a blocker until we get to the root cause.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
