RE: Improve Query Time For Large Index

2010-08-12 Thread Burton-West, Tom
ar.baz). The debug/explain will indicate whether the parsed query is a PhraseQuery. Tom -Original Message- From: Peter Karich [mailto:peat...@yahoo.de] Sent: Thursday, August 12, 2010 5:36 AM To: solr-user@lucene.apache.org Subject: Re: Improve Query Time For Large Index Hi Tom,

Re: Improve Query Time For Large Index

2010-08-12 Thread Robert Muir
exactly! On Thu, Aug 12, 2010 at 5:26 AM, Peter Karich wrote: > Hi Robert! > > > Since the example given was "http" being slow, its worth mentioning that > if > > queries are "one word" urls [for example http://lucene.apache.org] these > > will actually form slow phrase queries by default. > >

Re: Improve Query Time For Large Index

2010-08-12 Thread Peter Karich
. > > > > > > > > > > > Thanks, I will try that, if I can solve the current issue :-) And thanks for all your answers, I will try to experiment with my setup in more detail now ... Kind regards, Peter. > Subject: Re: Improve Query Time For Large Inde

Re: Improve Query Time For Large Index

2010-08-12 Thread Peter Karich
-Original Message----- > From: Peter Karich [mailto:peat...@yahoo.de] > Sent: Tuesday, August 10, 2010 3:32 PM > To: solr-user@lucene.apache.org > Subject: Re: Improve Query Time For Large Index > > Hi Tom, > > my index is around 3GB large and I am using 2GB RAM for the JVM

Re: Improve Query Time For Large Index

2010-08-12 Thread Peter Karich
Hi Robert! > Since the example given was "http" being slow, its worth mentioning that if > queries are "one word" urls [for example http://lucene.apache.org] these > will actually form slow phrase queries by default. > do you mean that http://lucene.apache.org will be split up into "http luce

Re: Improve Query Time For Large Index

2010-08-11 Thread Robert Muir
On Wed, Aug 11, 2010 at 11:47 AM, Burton-West, Tom wrote: > Hi Peter, > > Can you give a few more examples of slow queries? > Are they phrase queries? Boolean queries? prefix or wildcard queries? > If one word queries are your slow queries, than CommonGrams won't help. > CommonGrams will only hel

RE: Improve Query Time For Large Index

2010-08-11 Thread Burton-West, Tom
solr-user@lucene.apache.org Subject: Re: Improve Query Time For Large Index Hi Tom, my index is around 3GB large and I am using 2GB RAM for the JVM although a some more is available. If I am looking into the RAM usage while a slow query runs (via jvisualvm) I see that only 750MB of the JVM RAM is used.

Re: Improve Query Time For Large Index

2010-08-10 Thread Peter Karich
nd-common-words-part-2) > > Tom Burton-West > > -Original Message- > From: Peter Karich [mailto:peat...@yahoo.de] > Sent: Tuesday, August 10, 2010 9:54 AM > To: solr-user@lucene.apache.org > Subject: Improve Query Time For Large Index > > Hi, > > I have 5 Mil

RE: Improve Query Time For Large Index

2010-08-10 Thread Burton-West, Tom
earch/slow-queries-and-common-words-part-2) Tom Burton-West -Original Message- From: Peter Karich [mailto:peat...@yahoo.de] Sent: Tuesday, August 10, 2010 9:54 AM To: solr-user@lucene.apache.org Subject: Improve Query Time For Large Index Hi, I have 5 Million small documents/tweets (=&

Improve Query Time For Large Index

2010-08-10 Thread Peter Karich
Hi, I have 5 Million small documents/tweets (=> ~3GB) and the slave index replicates itself from master every 10-15 minutes, so the index is optimized before querying. We are using solr 1.4.1 (patched with SOLR-1624) via SolrJ. Now the search speed is slow >2s for common terms which hits more tha