[
https://issues.apache.org/jira/browse/SPARK-24701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736366#comment-16736366
]
Pablo Langa Blanco commented on SPARK-24701:
--------------------------------------------
Hi [~toopt4]
i think you have this functionality in the history server. For each application
spark starts new server (in a new port) and you have the history server up only
in one port monitoring all the applications.
As you can see ([https://spark.apache.org/docs/latest/monitoring.html)] "The
history server displays both completed and incomplete Spark jobs" "Incomplete
applications are only updated intermittently" spark.history.fs.update.interval
it could be a solution for you?
> SparkMaster WebUI allow all appids to be shown in detail on port 4040 rather
> than different ports per app
> ---------------------------------------------------------------------------------------------------------
>
> Key: SPARK-24701
> URL: https://issues.apache.org/jira/browse/SPARK-24701
> Project: Spark
> Issue Type: Improvement
> Components: Web UI
> Affects Versions: 2.3.1
> Reporter: t oo
> Priority: Major
> Labels: master, security, ui, web, web-ui
> Attachments: spark_ports.png
>
>
> Right now the detail for all application ids are shown on a diff port per app
> id, ie. 4040, 4041, 4042...etc this is problematic for environments with
> tight firewall settings. Proposing to allow 4040?appid=1, 4040?appid=2,
> 4040?appid=3..etc for the master web ui just like what the History Web UI
> does.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
