Re: Faceted Search Slows Down as index gets larger

2010-06-06 Thread Furkan Kuru
facet.limit = default value 100 facet.minCount is 1 The document count that matches the query is 8-10K in average. I did not calculate the terms (maybe using using facet.limit=-1 and facet.minCount=1) My index entirely fits into memory. On Sun, Jun 6, 2010 at 5:10 AM, Andy angelf...@yahoo.com

Re: Faceted Search Slows Down as index gets larger

2010-06-06 Thread Yonik Seeley
On Sun, Jun 6, 2010 at 7:38 AM, Furkan Kuru furkank...@gmail.com wrote: facet.limit = default value 100 facet.minCount is 1 The document count that matches the query is 8-10K in average. I did not calculate the terms (maybe using using facet.limit=-1 and facet.minCount=1) My index entirely

Re: Faceted Search Slows Down as index gets larger

2010-06-06 Thread Furkan Kuru
We try to provide real-time search. So the index is changing almost in every minute. We commit for every 100 documents received. The facet search is executed every 5 mins. Here is the stats result after facet search with normal facet.method=fc (it took 95 seconds) *name: * fieldValueCache

Re: Faceted Search Slows Down as index gets larger

2010-06-06 Thread Yonik Seeley
On Sun, Jun 6, 2010 at 1:12 PM, Furkan Kuru furkank...@gmail.com wrote: We try to provide real-time search. So the index is changing almost in every minute. We commit for every 100 documents received. The facet search is executed every 5 mins. OK, that's the problem - pretty much every

Re: Faceted Search Slows Down as index gets larger

2010-06-06 Thread John Wang
Using the Zoie/Bobo combination gives you realtime faceting. (Lucene based) http://sna-projects.com/zoie/ http://sna-projects.com/bobo/ wiki write-up: http://snaprojects.jira.com/wiki/display/BOBO/Realtime+Faceting+with+Zoie We can take this over to the zoie/bobo mailing list if you have

Re: Faceted Search Slows Down as index gets larger

2010-06-06 Thread Furkan Kuru
Ok, I will have a look at distributed search, multi-core solr solution. Thank you Yonik, On Sun, Jun 6, 2010 at 8:54 PM, Yonik Seeley yo...@lucidimagination.comwrote: On Sun, Jun 6, 2010 at 1:12 PM, Furkan Kuru furkank...@gmail.com wrote: We try to provide real-time search. So the index is

Re: solr configuration for local search

2010-06-06 Thread Avlesh Singh
Frank, w.r.t features you may draw a lot of inspiration from these two sites 1. http://mumbai.burrp.com/ 2. http://askme.in/ Both these products are Indian local search applications. #1 primarily focuses on the eating out domain. All the search/suggest related features on these sites are

Re: Faceted Search Slows Down as index gets larger

2010-06-06 Thread Andy
Yonik, Is there any documentation where I can read more about the big core + small core setup? One issue for me is that I don't just add new documents. Many of the changes is to update existing documents, such as updating the popularity score of the documents. Would the big core + small core