Re: first time query is very slow

2012-01-19 Thread Yonik Seeley
On Wed, Jan 18, 2012 at 10:15 PM, gabriel shen wrote: > Hi Yonik, > > The index I am querying against is 20gb, containing 200,000documents, some > of the documents are quite big, the schema contains more than 50 fields. > Main content field are defined as both stored and indexed, applied > htmlstr

Re: first time query is very slow

2012-01-18 Thread Otis Gospodnetic
en > To: solr-user@lucene.apache.org; yo...@lucidimagination.com > Cc: > Sent: Wednesday, January 18, 2012 10:15 PM > Subject: Re: first time query is very slow > > Hi Yonik, > > The index I am querying against is 20gb, containing 200,000documents, some > of the

Re: first time query is very slow

2012-01-18 Thread gabriel shen
Hi Yonik, The index I am querying against is 20gb, containing 200,000documents, some of the documents are quite big, the schema contains more than 50 fields. Main content field are defined as both stored and indexed, applied htmlstripping, standardtokenization, decompounding, stemming filters, wit

Re: first time query is very slow

2012-01-17 Thread Yonik Seeley
On Tue, Jan 17, 2012 at 9:39 AM, gabriel shen wrote: > For those customers who unluckily send un-prewarmed query, they will suffer > from bad response time, it is not too pleasant anyway. The "warming caches" part isn't about unique queries, but more about caches used for sorting and faceting (an

Re: first time query is very slow

2012-01-17 Thread gabriel shen
Thanks darren, I understand it will take longer time before warming up. What I am trying to find out is at the situation where we have no cache, why it will take so long time to complete the query, and what is the bottleneck? Fx, if I remove all qf, pf fields, the query speed will improve dramati

Re: first time query is very slow

2012-01-17 Thread darren
First query will cause the index caches to be warmed up and this is why the first query takes some time. You can prewarm the caches with a query (when solr starts up) of your choosing in the config file. Google around the SolrWiki on cache/index warming. hth > hi, > > I had an solr3.3 index of 2

first time query is very slow

2012-01-17 Thread gabriel shen
hi, I had an solr3.3 index of 200,000 documents, all text are stored and the total index size is 27gb. I used dismax query with over 10 qf and pf boosting field each, plus sorting on score and other 2 fields. It took quite a few seconds(5-8) for the first time query to return any result(no highlig