[
https://issues.apache.org/jira/browse/SPARK-28352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16884875#comment-16884875
]
Hyukjin Kwon commented on SPARK-28352:
--------------------------------------
Can you show the codes you run so that people can investigate the issue and fix?
> Spark UI misses some executor metrics
> -------------------------------------
>
> Key: SPARK-28352
> URL: https://issues.apache.org/jira/browse/SPARK-28352
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 2.4.1
> Reporter: Burak KÖSE
> Priority: Minor
> Attachments: executor_page.png, executor_summary.png, storage_page.png
>
>
> We have recently migrated our application from 2.2.1 to 2.4.1. We have
> realized that Spark UI is missing some critical information or shows wrong
> ones.
> We have a big cluster, with 80+ executors. It is Spark Streaming with
> customer receivers. On Spark UI in storage tab, we can see memory blocks and
> their size. This page shows correct information that we can see on Ganglia
> and host level monitors. However, in executor tab, `RDD blocks` shows `0`
> while we have thousands of them in memory. Moreover, `Storage Memory` shows
> incorrect numbers.
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
