Sorry to hijack the discussion, but I've been seeing the same behavior after upgrading from 0.17.2 to 0.18.1-dev. I am using map output compression.
-- Stefan > From: Arun C Murthy <[EMAIL PROTECTED]> > Reply-To: <core-user@hadoop.apache.org> > Date: Tue, 16 Sep 2008 12:56:28 -0700 > To: <core-user@hadoop.apache.org> > Subject: Re: reduce task progress above 100%? > > > On Sep 16, 2008, at 12:26 PM, pvvpr wrote: > >> Hello, >> A strange thing happened in my job. In reduce phase, one of the tasks >> status shows 101.44% complete and runs till some 102% and successfully >> finished back to 100%. Is this a right behavior? >> > > Which version of Hadoop are you running; and are you using compression > for map-outputs? > > Arun > >> I put a quick copy-paste of the web GUI reporting completion of the >> tasks. (sorry for the bad formatting below). >> >> thanks, >> Prasad Pingali, >> IIIT Hyderabad. >> >> >> >> Task Complete Status Start Time Finish Time Errors Counters >> task_200809151235_0026_r_000000 90.91% >> >> reduce > reduce >> 15-Sep-2008 18:40:06 >> >> >> >> >> 0 >> task_200809151235_0026_r_000004 86.13% >> >> reduce > reduce >> 15-Sep-2008 18:40:11 >> >> >> >> >> 0 >> task_200809151235_0026_r_000008 85.08% >> >> reduce > reduce >> 15-Sep-2008 18:40:16 >> >> >> >> >> 0 >> task_200809151235_0026_r_000012 82.57% >> >> reduce > reduce >> 15-Sep-2008 18:40:21 >> >> >> >> >> 0 >> task_200809151235_0026_r_000014 97.90% >> >> reduce > reduce >> 15-Sep-2008 18:40:22 >> >> >> >> >> 0 >> task_200809151235_0026_r_000017 101.44% >> reduce > reduce >> 15-Sep-2008 23:34:04 >> >> >> >> >> 0 >> >>
