[
https://issues.apache.org/jira/browse/SPARK-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta resolved SPARK-17874.
------------------------------------
Resolution: Fixed
Assignee: Marcelo Vanzin
Fix Version/s: 2.2.0
> Additional SSL port on HistoryServer should be configurable
> -----------------------------------------------------------
>
> Key: SPARK-17874
> URL: https://issues.apache.org/jira/browse/SPARK-17874
> Project: Spark
> Issue Type: Improvement
> Components: Web UI
> Affects Versions: 2.0.1
> Reporter: Andrew Ash
> Assignee: Marcelo Vanzin
> Fix For: 2.2.0
>
>
> When turning on SSL on the HistoryServer with
> {{spark.ssl.historyServer.enabled=true}} this opens up a second port, at the
> [hardcoded|https://github.com/apache/spark/blob/v2.0.1/core/src/main/scala/org/apache/spark/ui/JettyUtils.scala#L262]
> result of calculating {{spark.history.ui.port + 400}}, and sets up a
> redirect from the original (http) port to the new (https) port.
> {noformat}
> $ netstat -nlp | grep 23714
> (Not all processes could be identified, non-owned process info
> will not be shown, you would have to be root to see it all.)
> tcp 0 0 :::18080 :::*
> LISTEN 23714/java
> tcp 0 0 :::18480 :::*
> LISTEN 23714/java
> {noformat}
> By enabling {{spark.ssl.historyServer.enabled}} I would have expected the one
> open port to change protocol from http to https, not to have 1) additional
> ports open 2) the http port remain open 3) the additional port at a value I
> didn't specify.
> To fix this could take one of two approaches:
> Approach 1:
> - one port always, which is configured with {{spark.history.ui.port}}
> - the protocol on that port is http by default
> - or if {{spark.ssl.historyServer.enabled=true}} then it's https
> Approach 2:
> - add a new configuration item {{spark.history.ui.sslPort}} which configures
> the second port that starts up
> In approach 1 we probably need a way to specify to Spark jobs whether the
> history server has ssl or not, based on SPARK-16988
> That makes me think we should go with approach 2.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
