[ https://issues.apache.org/jira/browse/SPARK-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14261097#comment-14261097 ]
Apache Spark commented on SPARK-5007: ------------------------------------- User 'YanTangZhai' has created a pull request for this issue: https://github.com/apache/spark/pull/3845 > Try random port when startServiceOnPort to reduce the chance of port collision > ------------------------------------------------------------------------------ > > Key: SPARK-5007 > URL: https://issues.apache.org/jira/browse/SPARK-5007 > Project: Spark > Issue Type: Improvement > Components: Spark Core > Reporter: YanTang Zhai > Priority: Minor > > When multiple Spark programs are submitted at the same node (called > springboard machine). The ports (default 4040) of these SparkUIs are from > 4040 to 4056. Then the Spark programs submitted later would fail because of > SparkUI port collision. > The chance of port collision could be reduced by setting spark.ui.port or > spark.port.maxRetries. > However, I think it's better to try random port when startServiceOnPort to > reduce the chance of port collision. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org