[
https://issues.apache.org/jira/browse/SPARK-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020936#comment-14020936
]
Mridul Muralidharan commented on SPARK-2064:
--------------------------------------------
It is 100 MB (or more) of memory which could be used elsewhere.
In our clusters, for example, the number of workers can be very high while the
containers can be quite ephemeral when under load (and so lot of container
losses); on other hand, memory per container is constrained to about 8 gig
(lower when we account for overheads, etc).
So the amount of working memory in master reduces : we are finding that UI and
related codepath is one of the portions which seems to be occupying a lot of
memory in the OOM dumps of master.
> web ui should not remove executors if they are dead
> ---------------------------------------------------
>
> Key: SPARK-2064
> URL: https://issues.apache.org/jira/browse/SPARK-2064
> Project: Spark
> Issue Type: Sub-task
> Reporter: Reynold Xin
>
> We should always show the list of executors that have ever been connected,
> and add a status column to mark them as dead if they have been disconnected.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
