Github user squito commented on the issue: https://github.com/apache/spark/pull/14617 btw, anybody interested in looking at getting the memory to show up in the history server as well? this issue we were discussing earlier: >> AFAIK we don't record block update events in history server, so we could not calculate the used memory from event log. > good point, sorry I had totally forgotten about. Seems like this could be fixed w/ the info already in TaskEnd events though? separate from this change, but would be a nice improvement.
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org