[ https://issues.apache.org/jira/browse/MAPREDUCE-199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13451616#comment-13451616 ]
Harsh J commented on MAPREDUCE-199: ----------------------------------- It may make more sense to have a separate serialized structure for multi-hosts (for partitions), rather than leveraging the config object? Since the host list can grow and there are limits on the config object's serialization size. > Locality hints for Reduce > ------------------------- > > Key: MAPREDUCE-199 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-199 > Project: Hadoop Map/Reduce > Issue Type: New Feature > Components: applicationmaster, mrv2 > Reporter: Benjamin Reed > Assignee: Harsh J > Attachments: MAPREDUCE-199.patch, MAPREDUCE-199.patch > > > It would be nice if we could add method to OutputFormat that would allow a > job to indicate where a reducer for a given partition should should run. This > is similar to the getSplits() method on InputFormat. In our application the > reducer is using other data in addition to the map outputs during processing > and data accesses could be made more efficient if the JobTracker scheduled > the reducers to run on specific hosts. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira