Sometimes if my Hortonworks yarn-enabled cluster is fairly busy, Spark (via spark-submit) will begin its processing even though it apparently did not get all of the requested resources; it is running very slowly.
Is there a way to force Spark/YARN to only begin when it has the full set of resources that I request? Thanks, Arun
