[
https://issues.apache.org/jira/browse/SPARK-14328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Schmidt closed SPARK-14328.
-------------------------------
Resolution: Invalid
> Leaking JobProgressListener on master
> --------------------------------------
>
> Key: SPARK-14328
> URL: https://issues.apache.org/jira/browse/SPARK-14328
> Project: Spark
> Issue Type: Bug
> Affects Versions: 1.6.0
> Reporter: Max Schmidt
> Priority: Critical
>
> There is obviously a leak where JobProgressListener are held in a map on the
> master although the jobs that make the master add the listeners are all
> finished.
> A heapdump shows that after submitting 37 applications:
> 37 instances of "org.apache.spark.ui.jobs.JobProgressListener", loaded by
> "sun.misc.Launcher$AppClassLoader @ 0x6c0018b38" occupy 159.574.728 (50,37%)
> bytes.
> This leads to a OutOfMemoryException on the Master after a while.
> Workaround: Restart Master.
> Scenario to reproduce: Submit a spark application with the JavaSparkContext.
> Set spark.ui.enabled to false didn't change anything.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
