[ https://issues.apache.org/jira/browse/SPARK-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14174747#comment-14174747 ]
Nan Zhu commented on SPARK-3957: -------------------------------- Ok, when i work on executor tab, i rwslize that, we eventually need a per-executor record of broadcast usage....so will still follow the heartbeat based strategy > Broadcast variable memory usage not reflected in UI > --------------------------------------------------- > > Key: SPARK-3957 > URL: https://issues.apache.org/jira/browse/SPARK-3957 > Project: Spark > Issue Type: Bug > Components: Block Manager, Web UI > Affects Versions: 1.0.2, 1.1.0 > Reporter: Shivaram Venkataraman > Assignee: Nan Zhu > > Memory used by broadcast variables are not reflected in the memory usage > reported in the WebUI. For example, the executors tab shows memory used in > each executor but this number doesn't include memory used by broadcast > variables. Similarly the storage tab only shows list of rdds cached and how > much memory they use. > We should add a separate column / tab for broadcast variables to make it > easier to debug. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org