Re: imposed dynamic resource allocation

2015-12-18 Thread Andrew Or
Hi Antony, The configuration to enable dynamic allocation is per-application. If you only wish to enable this for one of your applications, just set `spark.dynamicAllocation.enabled` to true for that application only. The way it works under the hood is that application will start sending

imposed dynamic resource allocation

2015-12-11 Thread Antony Mayi
Hi, using spark 1.5.2 on yarn (client mode) and was trying to use the dynamic resource allocation but it seems once it is enabled by first app then any following application is managed that way even if explicitly disabling. example:1) yarn configured withÂ