at that time.
Yong
--
Date: Tue, 17 Sep 2013 09:49:06 -0400
Subject: Re: MAP_INPUT_RECORDS counter in the reducer
From: shahab.yu...@gmail.com
To: user@hadoop.apache.org
In the normal configuration, the issue here is that Reducers can start
before all the Maps have
Hi,
Is there a way for the reducer to get the total number of input records to
the map phase?
For example, I want the reducer to normalize a sum by dividing it in the
number of records. I tried getting the value of that counter by using the
line:
In the normal configuration, the issue here is that Reducers can start
before all the Maps have finished so it is not possible to get the number
(or make sense of it even if you are able to,)
Having said that, you can specifically make sure that Reducers don't start
until all your maps have
as your own properties, in the close() method of the mapper3) Retrieve
that property in the reducer close() method, then you have both numbers at that
time.
Yong
Date: Tue, 17 Sep 2013 09:49:06 -0400
Subject: Re: MAP_INPUT_RECORDS counter in the reducer
From: shahab.yu...@gmail.com
To: user
as your
own properties, in the close() method of the mapper
3) Retrieve that property in the reducer close() method, then you have
both numbers at that time.
Yong
--
Date: Tue, 17 Sep 2013 09:49:06 -0400
Subject: Re: MAP_INPUT_RECORDS counter in the reducer
From
