Trying to understand dynamic resource allocation

Hi, I am exploring a bit the dynamic resource allocation provided by the Standalone Cluster Mode and I was wondering whether this behavior I am experiencing is expected. In my configuration I have 3 slaves with 24 cores each. I have in my spark-defaults.conf: spark.shuffle.service.enabled true

Re: Trying to understand dynamic resource allocation

It works on Mesos, too. I'm not sure about Standalone mode. Dean Wampler, Ph.D. Author: Programming Scala, 2nd Edition (O'Reilly) Typesafe @deanwampler http://polyglotprogramming.com On Mon,

Re: Trying to understand dynamic resource allocation

My understanding is that dynamic allocation is only enabled for Spark-on-Yarn. Those settings likely have no impact in standalone mode. Nick On Mon, Jan 11, 2016, 5:10 AM Yiannis Gkoufas wrote: > Hi, > > I am exploring a bit the dynamic resource allocation provided by the