Github user kayousterhout commented on the pull request: https://github.com/apache/spark/pull/892#issuecomment-44345092 Yeah I agree with @mridulm. It seems like, with this change, you're counting on the executors to finish registering before the delay threshold runs out or before all of the tasks have been run. It seems cleaner to just wait until enough executors have started before launching jobs.
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---