do NOT start reduce task until all mappers are finished

Hi, I am using 0.18.2 with fair scheduler hadoop-3476. The purpose of fair scheduler is to prevent long running jobs from blocking short jobs. I gave it a try --- start a long job first, then a short one. The short job is able to grab some map slot and finishes its map phase quickly, but it st

Re: do NOT start reduce task until all mappers are finished

Haijun Cao wrote: Hi, I am using 0.18.2 with fair scheduler hadoop-3476. The purpose of fair scheduler is to prevent long running jobs from blocking short jobs. I gave it a try --- start a long job first, then a short one. The short job is able to grab some map slot and finishes its map pha

RE: do NOT start reduce task until all mappers are finished

Amar, Thanks for the pointer. -Original Message- From: Amar Kamat [mailto:[EMAIL PROTECTED] Sent: Monday, November 24, 2008 8:43 PM To: core-user@hadoop.apache.org Subject: Re: do NOT start reduce task until all mappers are finished Haijun Cao wrote: > Hi, > > > > I