Hi,
I'm setting my combiner and reducer to the same java class. Is there any
API that could tell me the context in which the java class is running after
the hadoop job is submitted to the cluster i.e whether the class is running
as a combiner or a reducer. I need this information to change the
Out
Hi Prasad,
My reply inline.
On Tue, Nov 6, 2012 at 4:15 PM, Prasad GS wrote:
> Hi,
>
> I'm setting my combiner and reducer to the same java class. Is there any API
> that could tell me the context in which the java class is running after the
> hadoop job is submitted to the cluster i.e whether t
I agree that the behaviour shouldn't be dynamically changed at runtime with
regard to the class being use as a Combiner or a Reducer but someone may
want to produce counters in order to have an overview of what is happening
(sanity check). But you really would like to be able to not aggregate the
s
Hi Bertrand,
I believe the framework does give a few combiner statistics of its own
(like in/out records and such). If your combiner class is separate,
then instantiating counters in it with apt naming should address the
need, since the class itself will be separately instantiated.
Even if we loo
