But then I need to set identity maps to run the reducers. If I suspend a job after the maps finish, I don't need to set identity maps up. I want to suspend a job so that I don't run identity maps and get better performance.
On Aug 25, 2016 10:12 PM, "Haibo Chen" <[email protected]> wrote: One thing you can try is to write a map-only job first and then verify the map out. On Thu, Aug 25, 2016 at 1:18 PM, xeon Mailinglist <[email protected] > wrote: > I am using Mapreduce v2. > > On Aug 25, 2016 8:18 PM, "xeon Mailinglist" <[email protected]> > wrote: > > > I am trying to implement a mechanism in MapReduce v2 that allows to > > suspend and resume a job. I must suspend a job when all the mappers > finish, > > and resume the job from that point after some time. I do this, because I > > want to verify the integrity of the map output before executing the > > reducers. > > > > I am looking for the class that tells when the Reduce tasks should start. > > Does anyone know where is this? > > >
