How to read multiple indices in parallel.

Hi all, As I can see the Multireader is reading the multiple indices sequentially (correct me if I am wrong). So using a IndexSearcher on a multireader will also perform sequential searches right? Is there a lucene-built-in class to search several indices parallely? -- Gimantha Bandara Software

Re: How to read multiple indices in parallel.

Hi Terry, I have multiple indices in separate locations. If I used multireader and used an executorservice with the indexSearcher It will go thru the segments in parallel and search right? But still searching between different indices will happen sequentially..Isnt it? On Tue, Apr 7, 2015 at

Re: How to read multiple indices in parallel.

Gimantha, With Lucene 5.0 you can pass in an ExecutorService to the constructor of your IndexSearcher and it will search the segments in parallel if you use one of the IndexSearcher.search() methods that returns a TopDocs (and don't supply your own Collector). The not-yet-released Lucene 5.1

Re: How to read multiple indices in parallel.

That was really helpful. Thanks a lot Terry! On Tue, Apr 7, 2015 at 8:17 PM, Terry Smith sheb...@gmail.com wrote: Gimantha, Search will run in parallel even across indices. This happens because IndexSearcher searches by LeafReader and it doesn't matter where those LeafReaders come from

Re: How to read multiple indices in parallel.

Gimantha, Search will run in parallel even across indices. This happens because IndexSearcher searches by LeafReader and it doesn't matter where those LeafReaders come from (DirectoryReader or MultiReader) they are all treated equally. Example: DirectoryReader(A): LeafReader(B),

Lucene (3.0) print payload information

Hi I have created a sample index with 2 fields i.e. [title body] I have saved payload information (float value) with title field. Now I am trying to print payload value for each term in title field. Getting termpositions from reader does not work. reader.termpoistion().isPayloadAvailable() is

Data structures used by Lucene

I am new to Lucene and curious to know the data structures/algorithms used behind the scene. Is there any documentation where I can find this? Thanks, Prateek

Fwd: Data structures used by Lucene

I am new to Lucene and curious to know the data structures/algorithms used behind the scene. Is there any documentation where I can find this? Thanks, Prateek

Re: Data structures used by Lucene

Hi Prateek, Using Luke, which is a GUI based browser tool for Lucene index, may be a good start to see the structure of Lucene index for you. https://github.com/DmitryKey/luke/ NLP4L also provides CUI based index browser for Lucene users aside from NLP functions.