[ https://issues.apache.org/jira/browse/SPARK-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14362907#comment-14362907 ]
Saisai Shao commented on SPARK-6304: ------------------------------------ Hi [~msoutier], seldom user will set this {{spark.driver.port}}, Spark itself will randomly choose a port and set it to SparkConf, so according to this, Spark Streaming will remove previously set port when recovering from checkpoint. Basically why {{spark.driver.port}} need to be fixed? And potentially it needs to be fixed when {{spark.driver.*}} is set by user. > Checkpointing doesn't retain driver port > ---------------------------------------- > > Key: SPARK-6304 > URL: https://issues.apache.org/jira/browse/SPARK-6304 > Project: Spark > Issue Type: Bug > Components: Streaming > Affects Versions: 1.2.1 > Reporter: Marius Soutier > > In a check-pointed Streaming application running on a fixed driver port, the > setting "spark.driver.port" is not loaded when recovering from a checkpoint. > (The driver is then started on a random port.) -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org