[
https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mariappan Asokan updated MAPREDUCE-4808:
----------------------------------------
Attachment: mapreduce-4808.patch
I have uploaded the latest patch.
Arun, thanks for your feedback. Your points are well taken. I realized that I
should have posted the details of an implementation of a plugin to justify the
design. Please take a look at the latest patch.
Chris, I thought about your suggestion on naming. I came up with the following
conclusions:
* Changing the name of {{MergeManager}} at this point may cause problems if
this Jira is ported to other branches(like 0.23.)
* The existing test {{TestMergeManager}} also has to be renamed.
So, I renamed {{MergeManagerPlugin}} to {{MergeManagerI}} since it is just an
interface. Is that okay?
Thanks.
-- Asokan
> Refactor MapOutput and MergeManager to facilitate reuse by Shuffle
> implementations
> ----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4808
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4808
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Arun C Murthy
> Assignee: Mariappan Asokan
> Attachments: COMBO-mapreduce-4809-4812-4808.patch,
> mapreduce-4808.patch, mapreduce-4808.patch, mapreduce-4808.patch,
> mapreduce-4808.patch, mapreduce-4808.patch, mapreduce-4808.patch,
> mapreduce-4808.patch, mapreduce-4808.patch, MergeManagerPlugin.pdf,
> MR-4808.patch
>
>
> Now that Shuffle is pluggable (MAPREDUCE-4049), it would be convenient for
> alternate implementations to be able to reuse portions of the default
> implementation.
> This would come with the strong caveat that these classes are LimitedPrivate
> and Unstable.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira