If you had set the number of reduce tasks to 0, you should not see the reduce>sort. How did you set the number of reducers? You could do that by doing
job.setNumReduceTasks(0); Jothi On 2/25/09 10:34 AM, "Vadim Zaliva" <kroko...@gmail.com> wrote: > On Thu, Feb 7, 2008 at 10:07, Owen O'Malley <o...@yahoo-inc.com> wrote: > >> Setting it to 0 skips all of the buffering, sorting, merging, and shuffling. >> It passes the objects straight from the mapper to the output format, which >> writes it straight to hdfs. > > I just tried to set number or Reduce tasks to 0, but Job Tracker shows > Reduce task working, doing "reduce > sort". I have a big data set and > it takes a while. It would be a good to find a way to skip it. > > Vadim
