Sandy Ryza created SPARK-1707: --------------------------------- Summary: Remove 3 second sleep before starting app on YARN Key: SPARK-1707 URL: https://issues.apache.org/jira/browse/SPARK-1707 Project: Spark Issue Type: Improvement Components: YARN Reporter: Sandy Ryza Assignee: Sandy Ryza
After acquiring allocations from YARN and launching containers, Spark currently waits for 3 seconds for executors to connect to the driver. On Spark standalone, nothing like this happens. I'm wondering whether we can just remove this sleep entirely. Is there a reason I'm missing why YARN is different than standalone in this regard? At the least we could do something smarter like wait until all executors have registered. -- This message was sent by Atlassian JIRA (v6.2#6252)