Re: Configure hadoop scheduler

2011-12-21 Thread Matei Zaharia
Hi Merto, a) is LATE scheduler a standalone scheduler or is integrated in fairscheduler? If is standalone where to find it and which hadoop version does it support? LATE is actually part of the common scheduling code that all of the schedulers in Hadoop use, implemented in the JobInProgress

Configure hadoop scheduler

2011-12-20 Thread Merto Mertek
Hi, I am having problems with changing the default hadoop scheduler (i assume that the default scheduler is a FIFO scheduler). I am following the guide located in hadoop/docs directory however I am not able to run it. Link for scheduling administration returns an http error 404 (

Re: Configure hadoop scheduler

2011-12-20 Thread Matei Zaharia
Are you trying to use the capacity scheduler or the fair scheduler? Your mapred-site.xml says to use the capacity scheduler but then points to a fair scheduler allocation file. Take a look at http://hadoop.apache.org/common/docs/r0.20.204.0/fair_scheduler.html for setting up the fair scheduler

Re: Configure hadoop scheduler

2011-12-20 Thread Prashant Kommireddi
I am guessing you are trying to use the FairScheduler but you have specified CapacityScheduler in your configuration. You need to change mapreduce.jobtracker.scheduler to FairScheduler. Sent from my iPhone On Dec 20, 2011, at 8:51 AM, Merto Mertek masmer...@gmail.com wrote: Hi, I am having