Re: Query performance in Lucene 4.x

2013-10-02 Thread Desidero
gt; > > > > > On Tue, Oct 1, 2013 at 4:10 PM, Desidero wrote: > > > > > > > Uwe, > > > > > > > > I was using a bounded thread pool. > > > > > > > > I don't know if the problem was the task overload or something

Re: Query performance in Lucene 4.x

2013-10-02 Thread Vitaly Funstein
y of searching a single segment rather than iterating > > over > > > multiple AtomicReaderContexts, but I'd lean toward task overload. I > will > > do > > > some testing tonight to find out for sure. > > > > > > Matt > > >

Re: Query performance in Lucene 4.x

2013-10-02 Thread Desidero
> Uwe Schindler > > H.-H.-Meier-Allee 63, D-28213 Bremen > > http://www.thetaphi.de > > eMail: u...@thetaphi.de > > > > > > > -Original Message- > > > From: Desidero [mailto:desid...@gmail.com] > > > Sent: Tuesday, October 01, 2013

Re: Query performance in Lucene 4.x

2013-10-02 Thread Vitaly Funstein
- > Uwe Schindler > H.-H.-Meier-Allee 63, D-28213 Bremen > http://www.thetaphi.de > eMail: u...@thetaphi.de > > > > -Original Message- > > From: Desidero [mailto:desid...@gmail.com] > > Sent: Tuesday, October 01, 2013 11:37 PM > > To: java-use

Re: Query performance in Lucene 4.x

2013-10-02 Thread Desidero
se a bounded thread pool. > > Uwe > > - > Uwe Schindler > H.-H.-Meier-Allee 63, D-28213 Bremen > http://www.thetaphi.de > eMail: u...@thetaphi.de > > > > -Original Message- > > From: Desidero [mailto:desid...@gmail.com] > > Sent: Tues

Re: Query performance in Lucene 4.x

2013-10-01 Thread Desidero
PM > To: java-user@lucene.apache.org > Subject: Re: Query performance in Lucene 4.x > > For anyone who was wondering, this was actually resolved in a different > thread today. I misread the information in the > IndexSearcher(IndexReader,ExecutorService) constructor documentation - I &

RE: Query performance in Lucene 4.x

2013-10-01 Thread Uwe Schindler
e.apache.org > Subject: Re: Query performance in Lucene 4.x > > For anyone who was wondering, this was actually resolved in a different > thread today. I misread the information in the > IndexSearcher(IndexReader,ExecutorService) constructor documentation - I > was under the impre

Re: Query performance in Lucene 4.x

2013-10-01 Thread Desidero
For anyone who was wondering, this was actually resolved in a different thread today. I misread the information in the IndexSearcher(IndexReader,ExecutorService) constructor documentation - I was under the impression that it was submitting a thread for each index shard (MultiReader wraps 20 shards,

Re: Query performance in Lucene 4.x

2013-09-27 Thread Desidero
Erick, Thank you for responding. I ran tests using both compressed fields and uncompressed fields, and it was significantly slower with uncompressed fields. I looked into the lazy field loading per your suggestion, but we don't get any values from the returned Documents until the result set has b

Re: Query performance in Lucene 4.x

2013-09-27 Thread Erick Erickson
Hmmm, since 4.1, fields have been stored compressed by default. I suppose it's possible that this is a result of compressing/uncompressing. What happens if 1> you enable lazy field loading 2> don't load any fields? FWIW, Erick On Thu, Sep 26, 2013 at 10:55 AM, Desidero wrote: > A quick update:

Re: Query performance in Lucene 4.x

2013-09-26 Thread Desidero
A quick update: In order to confirm that none of the standard migration changes had a negative effect on performance, I ported my Lucene 4.x version back to Lucene 3.6.2 and kept the newer API rather than using the custom ParallelMultiSearcher and other deprecated methods/classes. Performance in

Query performance in Lucene 4.x

2013-09-18 Thread Desidero
Hello, Over the last few weeks I've been working on upgrading an application from Lucene 3.x to Lucene 4.x in hopes of improving performance. Unfortunately, after going through the full migration process and playing with all sorts of tweaks I found online and in the documentation, Lucene 4 is runn