[ https://issues.apache.org/jira/browse/SPARK-29097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942339#comment-16942339 ]
George Papa commented on SPARK-29097: ------------------------------------- I think that SPARK-29055 resolved the increasing of the Storage Memory, so now I don't observe the high values of the driver memory. But, I don't know how the fixing SPARK-29055 secures the used memory < total memory in all the times. > Spark driver memory exceeded the storage memory > ----------------------------------------------- > > Key: SPARK-29097 > URL: https://issues.apache.org/jira/browse/SPARK-29097 > Project: Spark > Issue Type: Bug > Components: Block Manager, Spark Core, Web UI > Affects Versions: 2.3.3, 2.4.4 > Reporter: George Papa > Priority: Minor > > In Spark UI, the driver used storage memory (2.1GB) exceeds the total > available memory (1.5GB). When I use the same application with Spark 2.1.1 I > don't have this behavior. > > !https://i.stack.imgur.com/4gFYk.png! -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org