Thanks for the reply, actually what I was planning to do is to generate
artificial traces of map-reduce jobs and run them against SLS and
SLS+Tez to analyze the differences.
I asked here directly since I am pretty sure that in the Hadoop mailing
list they were going to tell me to ask you about it since that class is
app-specific, so I thought someone here may have already written an AM
simulator class for Tez. I doubt the SLS developers will do it any soon
(unless Tez will become part of the Hadoop code).
Anyway, no problem. Some tests in a small cluster will do the job ;)
Thanks again
Fabio
On 11/14/2014 07:54 PM, Hitesh Shah wrote:
Hello Fabio
We do not have a job trace file generated by Tez and therefore no simulator
that can re-run the trace. We do store some historical data for the job but the
level of tooling around it is pretty minimal.
— Hitesh
On Nov 14, 2014, at 3:29 AM, Fabio <[email protected]> wrote:
With SLS (Yarn Scheduler Load Simulator) I can test a MR job trace against different schedulers,
but to do so I see one has to specify "yarn.sls.am.type.mapreduce" that is "The
AMSimulator implementation for MapReduce-like applications. Users can specify implementations for
other type of applications.". As far as I understand this class is a simulator of the AM, so I
suppose that if I want to execute a job trace as if it is run on top of Tez, I should implement
this class in order to simulate a Tez AM.
Is this correct? A of today is there already some implementation of this?
Thanks in advance
Fabio
