fot MRv1, Its impossible.
On 2013-11-22 5:46 AM, Ivan Tretyakov itretya...@griddynamics.com
wrote:
Thank you for your replies!
We are using MR version 1 and my question is regarding this version.
Omkar,
are you talking about MR1 or MR2? I didn't find property to limit number
of running
Thank you for your replies!
We are using MR version 1 and my question is regarding this version.
Omkar,
are you talking about MR1 or MR2? I didn't find property to limit number of
running jobs per queue for capacity scheduler using MR1. Did I wrong
somewhere? What exactly option do you mean?
MRv2 :)
Thanks,
Omkar Joshi
*Hortonworks Inc.* http://www.hortonworks.com
On Thu, Nov 21, 2013 at 1:46 PM, Ivan Tretyakov itretya...@griddynamics.com
wrote:
Thank you for your replies!
We are using MR version 1 and my question is regarding this version.
Omkar,
are you talking about MR1
Hello!
We are using CDH 4.1.1 (Version: 2.0.0-mr1-cdh4.1.1) and fair-scheduler.
We need to limit total number of jobs which can run at the same time on
cluster.
I can see maxRunningJobs options but it sets limit for pool or user.
We wouldn't like to limit each pool or user we just need to set
Not sure about the fair scheduler but in capacity scheduler you can achieve
this by controlling number of jobs/applications per queue.
Thanks,
Omkar Joshi
*Hortonworks Inc.* http://www.hortonworks.com
On Tue, Nov 19, 2013 at 3:26 AM, Ivan Tretyakov itretya...@griddynamics.com
wrote:
Hello!
Unfortunately, this is not possible in the MR1 fair scheduler without
setting the jobs for individual pools. In MR2, fair scheduler hierarchical
queues will allow setting maxRunningApps at the top of the hierarchy, which
would have the effect you're looking for.
-Sandy
On Tue, Nov 19, 2013 at
