FilterCache issue

2009-06-17 Thread Manepalli, Kalyan
Hi, I am seeing an issue with the filtercache setting on my solr app which is causing slower faceting. Here is the configuration. Statistics: description: LRU Cache(maxSize=512, initialSize=512, autowarmCount=256, regenerator=org.apache.solr.search.solrindexsearche...@8d41f2) stat

Re: FilterCache issue

2009-06-17 Thread Mark Miller
Its been a while since I've thought about this sort of thing, but it looks like your cache is way too small and things get evicted before being used. How many uniques are you faceting on? 512 is the number of cache entries, not the size in kb/mb. Try raising it - perhaps a lot ;) But consider

RE: FilterCache issue

2009-06-17 Thread Manepalli, Kalyan
PM To: solr-user@lucene.apache.org Subject: Re: FilterCache issue Its been a while since I've thought about this sort of thing, but it looks like your cache is way too small and things get evicted before being used. How many uniques are you faceting on? 512 is the number of cache entries, no

Re: FilterCache issue

2009-06-17 Thread Mark Miller
hanks, Kalyan Manepalli -Original Message- From: Mark Miller [mailto:markrmil...@gmail.com] Sent: Wednesday, June 17, 2009 7:13 PM To: solr-user@lucene.apache.org Subject: Re: FilterCache issue Its been a while since I've thought about this sort of thing, but it looks like your cache

Re: FilterCache issue

2009-06-18 Thread Michael Ludwig
Manepalli, Kalyan schrieb: I am seeing an issue with the filtercache setting on my solr app which is causing slower faceting. Here is the configuration. hitratio : 0.00 inserts : 973531 evictions : 972978 size : 512 cumulative_hitratio : 0.00 cumulative_inserts : 61170111 cumulative_evict

Re: FilterCache issue

2009-06-18 Thread Grant Ingersoll
lli -Original Message- From: Mark Miller [mailto:markrmil...@gmail.com] Sent: Wednesday, June 17, 2009 7:13 PM To: solr-user@lucene.apache.org Subject: Re: FilterCache issue Its been a while since I've thought about this sort of thing, but it looks like your cache is way too small and t

Re: FilterCache issue

2009-06-18 Thread Mark Miller
unique items to facet on. Does the RAM size depend on Document size. Thanks, Kalyan Manepalli -Original Message- From: Mark Miller [mailto:markrmil...@gmail.com] Sent: Wednesday, June 17, 2009 7:13 PM To: solr-user@lucene.apache.org Subject: Re: FilterCache issue Its been a while since I&

Re: FilterCache issue

2009-06-18 Thread Yonik Seeley
On Thu, Jun 18, 2009 at 8:35 AM, Mark Miller wrote: > Thats why I asked about multi-valued terms. If hes not using the enum > faceting method (which only makes sense with fewer uniques), and the fields > are not multi-valued, than it is using the FieldCache method. Which of > course does use the fi

Re: FilterCache issue

2009-06-18 Thread Mark Miller
Yonik Seeley wrote: On Thu, Jun 18, 2009 at 8:35 AM, Mark Miller wrote: Thats why I asked about multi-valued terms. If hes not using the enum faceting method (which only makes sense with fewer uniques), and the fields are not multi-valued, than it is using the FieldCache method. Which of cour

Re: FilterCache issue

2009-06-18 Thread Mark Miller
Mark Miller wrote: Yonik Seeley wrote: On Thu, Jun 18, 2009 at 8:35 AM, Mark Miller wrote: Thats why I asked about multi-valued terms. If hes not using the enum faceting method (which only makes sense with fewer uniques), and the fields are not multi-valued, than it is using the FieldCache

RE: FilterCache issue

2009-06-18 Thread Manepalli, Kalyan
Subject: Re: FilterCache issue Mark Miller wrote: > Yonik Seeley wrote: >> On Thu, Jun 18, 2009 at 8:35 AM, Mark Miller >> wrote: >> >>> Thats why I asked about multi-valued terms. If hes not using the enum >>> faceting method (which only makes sense w

Re: FilterCache issue

2009-06-18 Thread Yonik Seeley
On Thu, Jun 18, 2009 at 10:59 AM, Manepalli, Kalyan wrote: > I am faceting on the single values only. You may have only added a single value to each field, but is the field defined to be single valued or multi valued? Also, what version of Solr are you using? -Yonik http://www.lucidimagination.c

RE: FilterCache issue

2009-06-18 Thread Manepalli, Kalyan
: solr-user@lucene.apache.org Subject: Re: FilterCache issue On Thu, Jun 18, 2009 at 10:59 AM, Manepalli, Kalyan wrote: > I am faceting on the single values only. You may have only added a single value to each field, but is the field defined to be single valued or multi valued? Also, what vers

Re: FilterCache issue

2009-06-18 Thread Yonik Seeley
9 10:15 AM > To: solr-user@lucene.apache.org > Subject: Re: FilterCache issue > > On Thu, Jun 18, 2009 at 10:59 AM, Manepalli, > Kalyan wrote: >> I am faceting on the single values only. > > You may have only added a single value to each field, but is the field > def

Re: FilterCache issue

2009-06-18 Thread Mark Miller
lf Of Yonik Seeley Sent: Thursday, June 18, 2009 10:15 AM To: solr-user@lucene.apache.org Subject: Re: FilterCache issue On Thu, Jun 18, 2009 at 10:59 AM, Manepalli, Kalyan wrote: I am faceting on the single values only. You may have only added a single value to each field, but i

Re: FilterCache issue

2009-06-18 Thread Yonik Seeley
On Thu, Jun 18, 2009 at 1:22 PM, Mark Miller wrote: > Maybe he is not using the FieldCache method? It occurs to me that this might be nice info to add to debugging info (the exact method used + perhaps some other info). -Yonik http://www.lucidimagination.com

RE: FilterCache issue

2009-06-18 Thread Manepalli, Kalyan
Mark, Where do we specify the method? fieldCache or otherwise Thanks, Kalyan Manepalli -Original Message- From: Mark Miller [mailto:markrmil...@gmail.com] Sent: Thursday, June 18, 2009 12:22 PM To: solr-user@lucene.apache.org Subject: Re: FilterCache issue Maybe he is not using

Re: FilterCache issue

2009-06-18 Thread Mark Miller
-Original Message- From: Mark Miller [mailto:markrmil...@gmail.com] Sent: Thursday, June 18, 2009 12:22 PM To: solr-user@lucene.apache.org Subject: Re: FilterCache issue Maybe he is not using the FieldCache method? Yonik Seeley wrote: On Thu, Jun 18, 2009 at 12:19 PM, Manepalli, Kalyan

RE: FilterCache issue

2009-06-18 Thread Manepalli, Kalyan
@lucene.apache.org Subject: Re: FilterCache issue Its the facet.method param: http://wiki.apache.org/solr/SimpleFacetParameters#head-7574cb658563f6de3ad54cd99a793cd73d593caa -- - Mark http://www.lucidimagination.com Manepalli, Kalyan wrote: > Mark, > Where do we specify the