RE: Multi-thread indexing, should the commit be called from each thread?

2014-05-22 Thread andi rexha
I was certainly asking about lucene! From: j...@basetechnology.com To: java-user@lucene.apache.org Subject: Re: Multi-thread indexing, should the commit be called from each thread? Date: Wed, 21 May 2014 11:53:46 -0400 (Was this supposed to be a java-user/Lucene question or a Solr

Re: Multi-thread indexing, should the commit be called from each thread?

2014-05-21 Thread Shai Erera
You don't need to commit from each thread, you can definitely commit when all threads are done. In general, you should commit only when you want to ensure the data is safe on disk. Shai On Wed, May 21, 2014 at 2:58 PM, andi rexha a_re...@hotmail.com wrote: Hi! I have a question about

Re: Multi-thread indexing, should the commit be called from each thread?

2014-05-21 Thread Erick Erickson
I'll be more emphatic than Shai; you should _definitely_ not commit from each thread, especially if you are doing a hard commit with openSearcher=true or a soft commit. In either case you open a new searcher which fires all your autowarming queries which.. IOW they're expensive operations. More

Re: Multi-thread indexing, should the commit be called from each thread?

2014-05-21 Thread Jack Krupansky
(Was this supposed to be a java-user/Lucene question or a Solr question?!) -- Jack Krupansky -Original Message- From: Erick Erickson Sent: Wednesday, May 21, 2014 10:58 AM To: java-user Subject: Re: Multi-thread indexing, should the commit be called from each thread? I'll be more