multiple spills/reducers test case for mergeParts() needed
----------------------------------------------------------
Key: HADOOP-4688
URL: https://issues.apache.org/jira/browse/HADOOP-4688
Project: Hadoop Core
Issue Type: Test
Components: mapred
Affects Versions: 0.19.1
Reporter: Yuri Pradkin
The first patch version (incorrect) for
http://issues.apache.org/jira/browse/HADOOP-4614 exposed a problem that
existing tests do not exercise some code paths of
MapOutputBuffer::mergeParts(). In particular, we need a test that would
validate output when numSpills >1 and partitions >1.
This might be a test that has more than 1 reducer and forces multiple first
level (map) spills by setting *io.sort.mb* (and possibly
*io.sort.spill.percent*) to small values.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
