Why do you want it start until all the resources are ready ? Make it start as early as possible should make it complete earlier and increase the utilization of resources
On Tue, Jun 23, 2015 at 10:34 PM, Arun Luthra <arun.lut...@gmail.com> wrote: > Sometimes if my Hortonworks yarn-enabled cluster is fairly busy, Spark > (via spark-submit) will begin its processing even though it apparently did > not get all of the requested resources; it is running very slowly. > > Is there a way to force Spark/YARN to only begin when it has the full set > of resources that I request? > > Thanks, > Arun >
