[ https://issues.apache.org/jira/browse/SPARK-13317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15148705#comment-15148705 ]
Christopher Bourez commented on SPARK-13317: -------------------------------------------- I'm trying my best, second time, but when I specify the public IP with {code}SPARK_PUBLIC_ID{code} I get an error during spark context initialization in spark-shell : {code} 16/02/16 14:40:51 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1. 16/02/16 14:40:51 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1. 16/02/16 14:40:51 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1. 16/02/16 14:40:51 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1. 16/02/16 14:40:51 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1. 16/02/16 14:40:51 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1. 16/02/16 14:40:51 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1. 16/02/16 14:40:51 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1. 16/02/16 14:40:51 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1. 16/02/16 14:40:51 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1. 16/02/16 14:40:51 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1. 16/02/16 14:40:51 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1. 16/02/16 14:40:51 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1. 16/02/16 14:40:51 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1. 16/02/16 14:40:51 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1. 16/02/16 14:40:51 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1. 16/02/16 14:40:51 ERROR SparkContext: Error initializing SparkContext. java.net.BindException: {code} Do you have any clue ? > SPARK_LOCAL_IP does not bind to public IP on Slaves > --------------------------------------------------- > > Key: SPARK-13317 > URL: https://issues.apache.org/jira/browse/SPARK-13317 > Project: Spark > Issue Type: Bug > Components: Deploy, EC2 > Environment: Linux EC2, different VPC > Reporter: Christopher Bourez > Priority: Minor > > SPARK_LOCAL_IP does not bind to the provided IP on slaves. > When launching a job or a spark-shell from a second network, the returned IP > for the slave is still the first IP of the slave. > So the job fails with the message : > Initial job has not accepted any resources; check your cluster UI to ensure > that workers are registered and have sufficient resources > It is not a question of resources but the driver which cannot connect to the > slave given the wrong IP. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org