Re: Hadoop schedulers!

2013-05-13 Thread Rahul Bhattacharjee
Any pointer to my question. There is another question , kind-of dumb , but just wanted to clarify. Say in a FIFO scheduler or a capacity scheduler , if there are slots available and the first job doesn't need all of the available slots , then the job next in the queue is scheduled for execution

Re: Hadoop schedulers!

2013-05-13 Thread Harsh J
Hi, On Sat, May 11, 2013 at 8:31 PM, Rahul Bhattacharjee rahul.rec@gmail.com wrote: Hi, I was going through the job schedulers of Hadoop and could not see any major operational difference between the capacity scheduler and the fair share scheduler apart from the fact that fair share

Re: Hadoop schedulers!

2013-05-13 Thread Alok Kumar
Hi, As the name suggest, Fair-scheduler does a fair allocation of slot to the jobs. Let say, you have 10 map slots in your cluster and it is occupied by a job-1 which requires 30 map slot to finish. But the same time, another job-2 require only 2 map slots to finish - Here slots will be provided

Re: Hadoop schedulers!

2013-05-13 Thread Rahul Bhattacharjee
Thanks a lot for the replies , it was really helpful. On Tue, May 14, 2013 at 1:02 AM, Alok Kumar alok...@gmail.com wrote: Hi, As the name suggest, Fair-scheduler does a fair allocation of slot to the jobs. Let say, you have 10 map slots in your cluster and it is occupied by a job-1 which

Hadoop schedulers!

2013-05-11 Thread Rahul Bhattacharjee
Hi, I was going through the job schedulers of Hadoop and could not see any major operational difference between the capacity scheduler and the fair share scheduler apart from the fact that fair share scheduler supports preemption and capacity scheduler doesn't. Another thing is the former