Re: long warmup duration

2010-02-19 Thread Antonio Lobato
You can disable warming, and a new searcher will register (almost) instantly, no matter the size. However, once you run your first search, you will be "warming" your searcher, and it will block for a long, long time, giving the end user a "frozen" page. Warming is just another word for "runni

Re: long warmup duration

2010-02-19 Thread Yonik Seeley
On Fri, Feb 19, 2010 at 12:17 PM, Stefan Neumann wrote: > I am quite confused with your configuration. It seems to me, that your > caches are extremly small for 30 million documents (128) The units of the cache are entries, not documents. So a queryResultCache autowarm count of a few dozen is nor

Re: long warmup duration

2010-02-19 Thread Stefan Neumann
Hey, I am quite confused with your configuration. It seems to me, that your caches are extremly small for 30 million documents (128) and during warmup you only put up to 20 docs in it. Please correct me if I misunderstand anything. In my opinion your warm up duration is not that impressiv, since

Re: long warmup duration

2010-02-17 Thread Antonio Lobato
Drop those cache numbers. Way down. I warm up 30 million documents in about 2 minutes with the following configuration: Mind you, I also use Solr 1.4. Also, setup a decent warming query or two, as so: date:[NOW-2DAYS TO NOW] 0 100 date desc Don't warm fa

long warmup duration

2010-02-17 Thread Stefan Neumann
Hi all, we are facing extremly increasing warmup times the last 15 days, which we are not able to explain, since the number of documents and their size is stable. Before the increase we can commit our changes in nearly 20 minutes, now it is about 2 hours. We were able to identify the warmup of t