[
https://issues.apache.org/jira/browse/SPARK-13483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yangping wu updated SPARK-13483:
--------------------------------
Description:
On YARN, when you run a Spark Streaming job, Spark web ui will record the
*Active Jobs* and *Completed Jobs* in the
http://l-hadoop-proxy-server:9981/proxy/application_XXXXXXX/jobs/ page:
!https://raw.githubusercontent.com/397090770/iteblog.github.com/master/sparkStreaming.png!
but the url address for streaming batch is error. because yarn has to go
through a proxy so the base uri is provided (_APPLICATION_WEB_PROXY_BASE_ or
_spark.ui.proxyBase_)and has to be on all links, so the right url is
+/proxy/application_1453101066555_1416734/streaming/batch/?id=1456370893000+
not +/streaming/batch/?id=1456370893000+
was:
On YARN, when you run a Spark Streaming job, Spark web ui will record the
*Active Jobs* and *Completed Jobs* in the
http://l-hadoop-proxy-server:9981/proxy/application_XXXXXXX/jobs/ page:
!https://raw.githubusercontent.com/397090770/iteblog.github.com/master/sparkStreaming.png!
but the url address for streaming batch is error. because yarn has to go
through a proxy so the base uri is provided
({code}APPLICATION_WEB_PROXY_BASE{code} or {code}spark.ui.proxyBase{code})and
has to be on all links, so the right url is
+/proxy/application_1453101066555_1416734/streaming/batch/?id=1456370893000+
and not +/streaming/batch/?id=1456370893000+
> URL address error in Spark web ui on YARN model
> -----------------------------------------------
>
> Key: SPARK-13483
> URL: https://issues.apache.org/jira/browse/SPARK-13483
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 1.5.2, 1.6.0
> Reporter: yangping wu
> Priority: Minor
>
> On YARN, when you run a Spark Streaming job, Spark web ui will record the
> *Active Jobs* and *Completed Jobs* in the
> http://l-hadoop-proxy-server:9981/proxy/application_XXXXXXX/jobs/ page:
> !https://raw.githubusercontent.com/397090770/iteblog.github.com/master/sparkStreaming.png!
> but the url address for streaming batch is error. because yarn has to go
> through a proxy so the base uri is provided (_APPLICATION_WEB_PROXY_BASE_ or
> _spark.ui.proxyBase_)and has to be on all links, so the right url is
> +/proxy/application_1453101066555_1416734/streaming/batch/?id=1456370893000+
> not +/streaming/batch/?id=1456370893000+
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
