Liang-Chi Hsieh created SPARK-19530:
---------------------------------------

             Summary: Use guava weigher for code cache eviction
                 Key: SPARK-19530
                 URL: https://issues.apache.org/jira/browse/SPARK-19530
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.1.0
            Reporter: Liang-Chi Hsieh


We use guava cache to cache compiled codes for codegen. Currently we use number 
of entries (100 as maximum now) in the cache to determine when to evict older 
entries.

However, the number of entries can't respond well to actually memory usage of 
cache entries. As we heavily rely codegen now and the generated codes can be 
large, we shouldn't use maximum of entries for code cache entry eviction.





--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to