[ https://issues.apache.org/jira/browse/SPARK-4049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035131#comment-15035131 ]
Warren Wang commented on SPARK-4049: ------------------------------------ This issue is really annoying when the rdd is reused for many times. For a particular execution, the fraction cached will increase 1%-10% unreasonably and never return back to 100%. When the rdd is reused for hundred times, the fraction cached will eventually reach to 200%, on which situation the spark job will crash for no more memory to use. Hope this to be fixed. > Storage web UI "fraction cached" shows as > 100% > ------------------------------------------------ > > Key: SPARK-4049 > URL: https://issues.apache.org/jira/browse/SPARK-4049 > Project: Spark > Issue Type: Bug > Components: Web UI > Affects Versions: 1.2.0 > Reporter: Josh Rosen > Priority: Minor > > In the Storage tab of the Spark Web UI, I saw a case where the "Fraction > Cached" was greater than 100%: > !http://i.imgur.com/Gm2hEeL.png! -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org