[
https://issues.apache.org/jira/browse/SPARK-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15395334#comment-15395334
]
Lve Chen commented on SPARK-16085:
----------------------------------
[~srowen] [~jerryshao]
I'm in a similar circumstance where we are in a large YARN cluster but with
only one yarn proxy server that runs along with yarn RM. Requests to access
driver UI, both from human and possibly programs to get metrics via REST API,
could easily blow up the yarn RM web port to which the yarn proxy server
listens.
I'm wondering whether it's a good approach to add a SPARK config to switch on
and off this redirecting, so that the request to driver UI can go directly to
the AM without going through yarn proxy server. I notice that there might be
security reasons that SparkUI is redirecting this way, could you share your
opinions on this?
> Spark stand-alone ui redirects to RM application master UI for yarn-client
> mode
> -------------------------------------------------------------------------------
>
> Key: SPARK-16085
> URL: https://issues.apache.org/jira/browse/SPARK-16085
> Project: Spark
> Issue Type: Bug
> Affects Versions: 1.6.1
> Reporter: Yesha Vora
>
> Spark UI in yarn-client mode redirects to Application Master UI.
> Run sparkPi application in yarn-client mode.
> When application is running , SparkUI is shown as " http://<host>:4040"
> {code}
> 16/06/17 01:13:46 INFO AbstractConnector: Started
> SelectChannelConnector@0.0.0.0:4040
> 16/06/17 01:13:46 INFO Utils: Successfully started service 'SparkUI' on port
> 4040.
> 16/06/17 01:13:46 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at
> http://xx.xx.xx.xxx:4040
> {code}
> The spark UI should be accessible at " http://<host>:4040". It should not be
> redirect to Application master ui.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
