LFUCache

2019-02-04 Thread Markus Jelsma
Hello,

Thanks to SOLR-12743 - one of our collections can't use FastLRUCache - we are 
considering LFUCache instead. But there is SOLR-3393 as well, claiming the 
current implementation is inefficient.

But ConcurrentLRUCache and ConcurrentLFUCache both use ConcurrentHashmap under 
the hood, the get() code is practically identical. So based on the code, i 
would think that, despite LFUCache being inefficient, it is neither slower nor 
faster than FastLRUCache for get(), right?

Or am i missing something obvious here?

Thanks,
Markus

https://issues.apache.org/jira/browse/SOLR-12743
https://issues.apache.org/jira/browse/SOLR-3393


Re: Solr Core Reload causing JVM Memory Leak through FieldCache/LRUCache/LFUCache

2013-11-15 Thread Umesh Prasad
Mailing list by default removes attachments. So uploaded it to google drive
..

https://drive.google.com/file/d/0B-RnB4e-vaJhX280NVllMUdHYWs/edit?usp=sharing



On Fri, Nov 15, 2013 at 2:28 PM, Umesh Prasad umesh.i...@gmail.com wrote:

 Hi All,
 We are seeing memory leaks in our Search application whenever core
 reload happens after replication.
We are using Solr 3.6.2 and I have observed this consistently on all
 servers.

 The leak suspect analysis from MAT is attached with the mail.

  #1425afb4a706064b_  Problem Suspect 1

 One instance of *org.apache.lucene.search.FieldCacheImpl*loaded by 
 *org.apache.catalina.loader.WebappClassLoader
 @ 0x7f7b0a5b8b30* occupies *8,726,099,312 (35.49%)* bytes. The memory is
 accumulated in one instance of*java.util.HashMap$Entry[]* loaded by 
 *system
 class loader*.

 *Keywords*
 org.apache.catalina.loader.WebappClassLoader @ 0x7f7b0a5b8b30
 java.util.HashMap$Entry[]
 org.apache.lucene.search.FieldCacheImpl

 Problem Suspect 2

 69 instances of *org.apache.solr.util.ConcurrentLRUCache*, loaded by 
 *org.apache.catalina.loader.WebappClassLoader
 @ 0x7f7b0a5b8b30* occupy *6,309,187,392 (25.66%)* bytes.

 Biggest instances:

- org.apache.solr.util.ConcurrentLRUCache @
0x7f7fe74ef120 - 755,575,672 (3.07%) bytes.
- org.apache.solr.util.ConcurrentLRUCache @
0x7f7e74b7a068 - 728,731,344 (2.96%) bytes.
- org.apache.solr.util.ConcurrentLRUCache @
0x7f7d0a6bd1b8 - 711,828,392 (2.90%) bytes.
- org.apache.solr.util.ConcurrentLRUCache @
0x7f7c6c12e800 - 708,657,624 (2.88%) bytes.
- org.apache.solr.util.ConcurrentLRUCache @
0x7f7fcb092058 - 568,473,352 (2.31%) bytes.
- org.apache.solr.util.ConcurrentLRUCache @
0x7f7f268cb2f0 - 568,400,040 (2.31%) bytes.
- org.apache.solr.util.ConcurrentLRUCache @
0x7f7e31b60c58 - 544,078,600 (2.21%) bytes.
- org.apache.solr.util.ConcurrentLRUCache @
0x7f7e65c2b2d8 - 489,578,480 (1.99%) bytes.
- org.apache.solr.util.ConcurrentLRUCache @
0x7f7d81ea8538 - 467,833,720 (1.90%) bytes.
- org.apache.solr.util.ConcurrentLRUCache @
0x7f7f31996508 - 444,383,992 (1.81%) bytes.



 *Keywords*
 org.apache.catalina.loader.WebappClassLoader @ 0x7f7b0a5b8b30
 org.apache.solr.util.ConcurrentLRUCache
 Details ยป http://pages/24.html

 194 instances of *org.apache.solr.util.ConcurrentLFUCache*, loaded by 
 *org.apache.catalina.loader.WebappClassLoader
 @ 0x7f7b0a5b8b30* occupy *4,583,727,104 (18.64%)* bytes.

 Biggest instances:

- org.apache.solr.util.ConcurrentLFUCache @
0x7f7cdd4735a0 - 410,628,176 (1.67%) bytes.
- org.apache.solr.util.ConcurrentLFUCache @
0x7f7c7d48e180 - 390,690,864 (1.59%) bytes.
- org.apache.solr.util.ConcurrentLFUCache @
0x7f7f1edfd008 - 348,193,312 (1.42%) bytes.
- org.apache.solr.util.ConcurrentLFUCache @
0x7f7f37b01990 - 340,595,920 (1.39%) bytes.
- org.apache.solr.util.ConcurrentLFUCache @
0x7f7fe02d8dd8 - 274,611,632 (1.12%) bytes.
- org.apache.solr.util.ConcurrentLFUCache @
0x7f7fa9dcfb20 - 253,848,232 (1.03%) bytes.



 *Keywords*
 org.apache.catalina.loader.WebappClassLoader @ 0x7f7b0a5b8b30
 org.apache.solr.util.ConcurrentLFUCache


 ---
 Thanks  Regards
 Umesh Prasad

 SDE @ Flipkart  : The Online Megastore at your doorstep ..




-- 
---
Thanks  Regards
Umesh Prasad