Re: hybrid map/reducer scheduler?

2010-06-29 Thread Steve Loughran
point, and datacentre scheduling is right up there with VM and data placement as cutting edge problems --- On Mon, 6/28/10, He Chen airb...@gmail.com wrote: From: He Chen airb...@gmail.com Subject: Re: hybrid map/reducer scheduler? To: common-user@hadoop.apache.org Date: Monday, June 28, 2010, 7

hybrid map/reducer scheduler?

2010-06-28 Thread jiang licht
In addition to default FIFO scheduler, there are fair scheduler and capacity scheduler. In some sense, fair scheduler can be considered a user-based scheduling while capacity scheduler does a queue-based scheduling. Is there or will there be a hybrid scheduler that combines the good parts of

Re: hybrid map/reducer scheduler?

2010-06-28 Thread He Chen
You can write your own one based on them. They are open source. On Mon, Jun 28, 2010 at 6:13 PM, jiang licht licht_ji...@yahoo.com wrote: In addition to default FIFO scheduler, there are fair scheduler and capacity scheduler. In some sense, fair scheduler can be considered a user-based

Re: hybrid map/reducer scheduler?

2010-06-28 Thread jiang licht
Yeah, will give it a try :) Thanks, -Michael --- On Mon, 6/28/10, He Chen airb...@gmail.com wrote: From: He Chen airb...@gmail.com Subject: Re: hybrid map/reducer scheduler? To: common-user@hadoop.apache.org Date: Monday, June 28, 2010, 7:09 PM You can write your own one based on them

Re: hybrid map/reducer scheduler?

2010-06-28 Thread Hemanth Yamijala
Michael, In addition to default FIFO scheduler, there are fair scheduler and capacity scheduler. In some sense, fair scheduler can be considered a user-based scheduling while capacity scheduler does a queue-based scheduling. Is there or will there be a hybrid scheduler that combines the