[
https://issues.apache.org/jira/browse/MAPREDUCE-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Douglas updated MAPREDUCE-776:
------------------------------------
Attachment: M776-3.patch
Updated based on feedback from Hong
> Gridmix: Trace-based benchmark for Map/Reduce
> ---------------------------------------------
>
> Key: MAPREDUCE-776
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-776
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: benchmarks
> Reporter: Chris Douglas
> Assignee: Chris Douglas
> Attachments: M776-1.patch, M776-2.patch, M776-3.patch, MR776-0.patch
>
>
> Previous benchmarks ( HADOOP-2369 , HADOOP-3770 ), while informed by
> production jobs, were principally load generating tools used to validate
> stability and performance under saturation. The important dimensions of that
> load- submission order/rate, I/O profile, CPU usage, etc- only accidentally
> match that of the real load on the cluster. Given related work that
> characterizes production load ( MAPREDUCE-751 ), it would be worthwhile to
> use mined data to impose a corresponding load for tuning and guiding
> development of the framework.
> The first version will focus on modeling task I/O, submission, and memory
> usage.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.