[
https://issues.apache.org/jira/browse/HADOOP-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Douglas updated HADOOP-4688:
----------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I just committed this
> multiple spills/reducers test case for mergeParts() needed
> ----------------------------------------------------------
>
> Key: HADOOP-4688
> URL: https://issues.apache.org/jira/browse/HADOOP-4688
> Project: Hadoop Core
> Issue Type: Test
> Components: mapred
> Affects Versions: 0.19.1
> Reporter: Yuri Pradkin
> Assignee: Chris Douglas
> Fix For: 0.20.0
>
> Attachments: 4688-0.patch
>
>
> The first patch version (incorrect) for
> http://issues.apache.org/jira/browse/HADOOP-4614 exposed a problem that
> existing tests do not exercise some code paths of
> MapOutputBuffer::mergeParts(). In particular, we need a test that would
> validate output when numSpills >1 and partitions >1.
> This might be a test that has more than 1 reducer and forces multiple first
> level (map) spills by setting *io.sort.mb* (and possibly
> *io.sort.spill.percent*) to small values.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
