[
https://issues.apache.org/jira/browse/MAPREDUCE-1126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12805149#action_12805149
]
Doug Cutting commented on MAPREDUCE-1126:
-----------------------------------------
Jay, there's been an effort to move job accessor methods away from Job.java
unless they're required by the mapreduce framework. For example,
Job#setInputPath(Path) moved to FileInputFormat#setInputPath(Job, Path), since
not all jobs have files for input, and the file-specific code is all
user-replaceable, not built into the mapreduce system. Similarly, after the
current patch for this issue is applied, the framework no longer contains calls
to any particular serialization system (except in deprecated back-compatibility
methods).
> shuffle should use serialization to get comparator
> --------------------------------------------------
>
> Key: MAPREDUCE-1126
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1126
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: task
> Reporter: Doug Cutting
> Assignee: Aaron Kimball
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1126.2.patch, MAPREDUCE-1126.3.patch,
> MAPREDUCE-1126.4.patch, MAPREDUCE-1126.5.patch, MAPREDUCE-1126.6.patch,
> MAPREDUCE-1126.patch
>
>
> Currently the key comparator is defined as a Java class. Instead we should
> use the Serialization API to create key comparators. This would permit,
> e.g., Avro-based comparators to be used, permitting efficient sorting of
> complex data types without having to write a RawComparator in Java.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
