Yes. Fair schedulwr only helps concurrency within an application. With
multiple shells you'd either need something like Yarn/Mesos or careful math on
resources as you said
Sent on the new Sprint Network from my Samsung Galaxy S®4.
div Original message /divdivFrom: Arun Patel
YARN capacity scheduler support hierarchical queues, which you can assign
cluster resource as percentage. Your spark application/shell can be
submitted to different queues. Mesos supports fine-grained mode, which
allows the machines/cores used each executors ramp up and down.
Lan
On Wed, Apr 22,
