[ 
https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13551200#comment-13551200
 ] 

Mariappan Asokan commented on MAPREDUCE-4808:
---------------------------------------------

Hi Jerry,
  Thanks for your feedback and comments.  There may be several ways you can 
implement a {{MergeManager}} plugin.  Inheriting from current {{MergeManager}} 
is one of them that you tried for your implementation.

I would suggest you take a look at the test that I created for the patch.  It 
contains a plugin implementation that does not do any sorting both on the map 
and reduce sides.  Although it is a very simple implementation, it is a good 
starting point for your hash aggregation.  I attached it to some of the 
previous patches I posted for MAPREDUCE-2454.  If you want the latest copy, 
please shoot an e-mail to me.  I will send it to you.

-- Asokan

                
> Allow reduce-side merge to be pluggable
> ---------------------------------------
>
>                 Key: MAPREDUCE-4808
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4808
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>    Affects Versions: 2.0.2-alpha
>            Reporter: Arun C Murthy
>            Assignee: Mariappan Asokan
>             Fix For: 2.0.3-alpha
>
>         Attachments: COMBO-mapreduce-4809-4812-4808.patch, 
> mapreduce-4808.patch, mapreduce-4808.patch, mapreduce-4808.patch, 
> mapreduce-4808.patch, mapreduce-4808.patch, MergeManagerPlugin.pdf
>
>
> Allow reduce-side merge to be pluggable for MAPREDUCE-2454

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to