On Thu, Oct 2, 2008 at 2:44 AM, Steve Gao <[EMAIL PROTECTED]> wrote: > I have 5 running jobs, each has 2 reducers. Because I set max number of > reducers as 10 so any incoming job will be hold until some of the 5 jobs > finish and release reducer quota. > > Now the problem is that an incoming job has a higher priority that I want to > pause some of the 5 jobs, let the new job finish, and resume the old one. > > Is this doable in Hadoop? Thanks!
You could use the patch attached to this JIRA to do this: https://issues.apache.org/jira/browse/HADOOP-3687 Since paused tasks are kept in memory there is a limit on how much you can pause with this patch, but nevertheless is can be very useful in practice. -Klaas
