[
https://issues.apache.org/jira/browse/HADOOP-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Douglas updated HADOOP-2233:
----------------------------------
Attachment: 2233-3.patch
This uses package-private, inner classes from RandomWriter. It would either
duplicate a fair amount of code or require opening up RandomWriter to move it
outside of the examples.
This patch addresses many of Owen's comments: rolling the "indirect" tool into
a more aptly named "GenericMRLoadGenerator" class and moving the indirection
out of a custom Mapper class and into IndirectInputFormat::getRecordReader.
> General example for modeling m/r load in Java
> ---------------------------------------------
>
> Key: HADOOP-2233
> URL: https://issues.apache.org/jira/browse/HADOOP-2233
> Project: Hadoop
> Issue Type: Improvement
> Components: examples
> Reporter: Chris Douglas
> Assignee: Chris Douglas
> Priority: Minor
> Fix For: 0.16.0
>
> Attachments: 2233-0.patch, 2233-1.patch, 2233-2.patch, 2233-3.patch
>
>
> This matches the hadoop.sort.(map|reduce).keep.percent interface in
> HADOOP-2127 and includes an "indirect" sort matching some user apps (when
> locality information is unavailable). It mostly, merely merges parts of the
> RandomWriter and Sort examples to effect sample loads in map/reduce.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
