[ https://issues.apache.org/jira/browse/SPARK-31602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420286#comment-17420286 ]
muhong commented on SPARK-31602: -------------------------------- we meet the same question on the spark driver side,but not find the answer。 we found the leak JobConf associate inside the DistributeFileSystem,the DistributeFileSystem are store in the FileSystem$Cache, it seems that the DistributeFileSystem were not closed; > memory leak of JobConf > ---------------------- > > Key: SPARK-31602 > URL: https://issues.apache.org/jira/browse/SPARK-31602 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 2.4.0 > Reporter: angerszhu > Priority: Major > Labels: bulk-closed > Attachments: image-2020-04-29-14-34-39-496.png, > image-2020-04-29-14-35-55-986.png > > > !image-2020-04-29-14-34-39-496.png! > !image-2020-04-29-14-35-55-986.png! -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org