[
https://issues.apache.org/jira/browse/SPARK-13305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145512#comment-15145512
]
Jacek Laskowski commented on SPARK-13305:
-----------------------------------------
I was explicit about the different ways of setting the port of the worker's web
UI, but it could be harder to figure out. {{SPARK_WORKER_WEBUI_PORT=11111}}
could be in {{conf/spark-env.sh}}.
The point is that
[WorkerArguments|https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/deploy/worker/WorkerArguments.scala#L48]
is doing the env var lookup anyway and there is no need to have the env var
mapped to {{--webui-port}} inside {{sbin/start-slave.sh}}. I think
{{sbin/start-slave.sh}} should *not* set it as {{--webui-port}}, but just
{{export}} it (as {{bin/load-spark-env.sh}} does with the other env vars).
It should be an easy fix that would make the Spark command easier on eyes, i.e.
without {{--webui-port}} used twice (that looks just...messy).
> With SPARK_WORKER_WEBUI_PORT and --webui-port set for start-slave.sh script,
> --webui-port is used twice
> -------------------------------------------------------------------------------------------------------
>
> Key: SPARK-13305
> URL: https://issues.apache.org/jira/browse/SPARK-13305
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.0.0
> Reporter: Jacek Laskowski
> Priority: Minor
>
> Executing the following command to start a worker:
> {code}
> SPARK_WORKER_WEBUI_PORT=11111 ./sbin/start-slave.sh spark://localhost:7077
> --webui-port 22222
> {code}
> ends up with the following Spark command (in the log file) -- some characters
> cut off to make it relevant:
> {code}
> Spark Command: [cut] org.apache.spark.deploy.worker.Worker --webui-port 11111
> spark://localhost:7077 --webui-port 22222
> {code}
> Note {{--webui-port}} set twice.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
