[
https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17279548#comment-17279548
]
Yang Jie edited comment on SPARK-34309 at 2/5/21, 10:16 AM:
------------------------------------------------------------
[~dongjoon] I use the code in
[GetPutBenchmark|https://github.com/ben-manes/caffeine/blob/master/caffeine/src/jmh/java/com/github/benmanes/caffeine/cache/GetPutBenchmark.java]
to compare the performance of caffeine, guava cache, LinkedHashMap and
ConcurrentLinkedHashMap, the result as follows:
# read write thrpt test (6 threads read and 2 threads write):
||cacheType||Score(Units)||
|LinkedHashMap_Lru|11248568.197 ± 12737170.642 ops/s|
|Caffeine|44638046.442 ± 23455184.501 ops/s|
|ConcurrentLinkedHashMap|30133621.108 ± 21890181.254 ops/s|
|Guava|14867777.653 ± 5716763.921 ops/s|
# read only (8 threads read):
!image-2021-02-05-18-08-48-852.png!
# write only (8 threads write):
was (Author: luciferyang):
[~dongjoon] I use the code in
[GetPutBenchmark|https://github.com/ben-manes/caffeine/blob/master/caffeine/src/jmh/java/com/github/benmanes/caffeine/cache/GetPutBenchmark.java]
to compare the performance of caffeine, guava cache, LinkedHashMap and
ConcurrentLinkedHashMap, the result as follows:
# read write (6 threads read and 2 threads write):
||cacheType||Score(Units)||
|LinkedHashMap_Lru|11248568.197 ± 12737170.642 ops/s|
|Caffeine|44638046.442 ± 23455184.501 ops/s|
|ConcurrentLinkedHashMap|30133621.108 ± 21890181.254 ops/s|
|Guava|14867777.653 ± 5716763.921 ops/s|
# read only (8 threads read):
!image-2021-02-05-18-08-48-852.png!
# write only (8 threads write):
> Use Caffeine instead of Guava Cache
> -----------------------------------
>
> Key: SPARK-34309
> URL: https://issues.apache.org/jira/browse/SPARK-34309
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core, SQL
> Affects Versions: 3.2.0
> Reporter: Yang Jie
> Priority: Minor
> Attachments: image-2021-02-05-18-08-48-852.png, screenshot-1.png
>
>
> Caffeine is a high performance, near optimal caching library based on Java 8,
> it is used in a similar way to guava cache, but with better performance. The
> comparison results are as follow are on the [caffeine benchmarks
> |https://github.com/ben-manes/caffeine/wiki/Benchmarks]
> At the same time, caffeine has been used in some open source projects like
> Cassandra, Hbase, Neo4j, Druid, Spring and so on.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
