I did some further investigation. If I launch a driver in cluster mode with master IPs like spark://<primary>:7077,<secondary>:7077, the the driver is launched with both IPs and -Dspark.master property has both IPs.
But within the logs I see the following, it causes 20 second delay while launching each driver 18/06/28 08:19:34 INFO RestSubmissionClient: Submitting a request to launch an application in spark://<primary>:7077,<secondary>:7077. 18/06/28 08:19:44 WARN RestSubmissionClient: Unable to connect to server spark://<primary>:7077. 18/06/28 08:19:54 WARN RestSubmissionClient: Unable to connect to server spark://<secondary>:7077. Warning: Master endpoint spark://<primary>:7077,<secondary>:7077 was not a REST server. Falling back to legacy submission gateway instead. -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
