Re: Pools and extra capacity?

2017-08-17 Thread David Capwell
Thanks for the details; yeah was expecting this behavior On Aug 17, 2017 12:36 PM, "Maxime Beauchemin" wrote: > The point of pools is to limit parallelism on a logical set of tasks > instances to a certain number. Overflowing into another pool would break > the only guarantee it provides. > > `p

Re: Pools and extra capacity?

2017-08-17 Thread Maxime Beauchemin
The point of pools is to limit parallelism on a logical set of tasks instances to a certain number. Overflowing into another pool would break the only guarantee it provides. `priority_weigth` works along with pool to define which task should be scheduled first once slots open up. It won't kill any

Pools and extra capacity?

2017-08-16 Thread David Capwell
I'm looking into pools and had a few questions Let's say I have two pools, each of 50% of the cluster. If one pool is at capacity and has a backlog, but the other pool is idle, will airflow allow the first pool's work to start consuming the slots from the idle pool, and if so is their preemption