Thank you for your help!
I wrote an article on Performance Testing Solr filterCache Shedding Light
on Apache Solr filterCache for VuFind that I am hoping to get published.
https://docs.google.com/document/d/1vl-nmlprSULvNZKQNrqp65eLnLhG9s_ydXQtg9iML10
Anyone can comment and I would highly
Ben:
As Shawn says, you're on the right track...
Do note, though, that a 10K size here is probably excessive, YMMV of course.
And an autowarm count of 5,000 is almost _certainly_ far more than you
want. All these fq clauses get re-executed whenever a new searcher is
opened (soft commit or hard
Thanks to both of you. Yes the mentioned config is illustrative, we decided
for 512 after thorough testing. However, when you google Solr filterCache
the first link is the community wiki which has a config even higher than
the illustration which is quite different from the official reference
That's specific to using the facet.method=enum, but do admit it's easy
to miss that.
I added a note about that though...
Thanks for pointing that out!
On Thu, Jun 19, 2014 at 9:38 AM, Benjamin Wiens
benjamin.wi...@gmail.com wrote:
Thanks to both of you. Yes the mentioned config is
Hi,
I'm looking for a formula to calculate filterCache size in the RAM.
The best estimation I can find is here
http://stackoverflow.com/questions/2004/solr-filter-cache-fastlrucache-takes-too-much-memory-and-results-in-out-of-mem
An index of 1.000.000 would thus take 12,5 GB in the RAM with
You pretty much have it. Actually, the number you want is the maxDoc
figure from the admin UI screen. The formula will be maxDoc/8 bytes +
(some overhead but not enough to matter), for EVERY entry.
You'll never fit 100B docs on a single machine anyway. Lucene has a
hard limit of 2B docs, and I've
Thanks Erick!
So let's say I have a config of
filterCache
class=solr.FastLRUCache
size=1
initialSize=1
autowarmCount=5000/
MaxDocuments = 1,000,000
So according to your formula, filterCache should roughly have the potential
to consume this much RAM:
((1,000,000 / 8) + 128) * (10,000) =
On 6/18/2014 10:57 AM, Benjamin Wiens wrote:
Thanks Erick!
So let's say I have a config of
filterCache
class=solr.FastLRUCache
size=1
initialSize=1
autowarmCount=5000/
MaxDocuments = 1,000,000
So according to your formula, filterCache should roughly have the potential
to
