gagan taneja created SPARK-24437:
------------------------------------

             Summary: Memory leak in UnsafeHashedRelation
                 Key: SPARK-24437
                 URL: https://issues.apache.org/jira/browse/SPARK-24437
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.2.0
            Reporter: gagan taneja


There seems to memory leak with 
org.apache.spark.sql.execution.joins.UnsafeHashedRelation

We have a long running instance of STS.

With each query execution requiring Broadcast Join, UnsafeHashedRelation is 
getting added for cleanup in ContextCleaner. This reference of 
UnsafeHashedRelation is being held at some other Collection and not becoming 
eligible for GC and because of this ContextCleaner is not able to clean it.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to