Re: manually merging Directories

2014-12-29 Thread Shaun Senecal
Hi Mike That's actually what I was looking at doing, I was just hoping there was a way to avoid the "copySegmentAsIs" step and simply replace it with a "rename" operation on the file system. It seemed like low hanging fruit, but Uwe and Erick have now told me that the segments have dependencie

Re: confirm unsubscribe from java-user@lucene.apache.org

2014-12-29 Thread mck
On Mon, 29 Dec 2014, at 23:58, java-user-h...@lucene.apache.org wrote: > Hi! This is the ezmlm program. I'm managing the > java-user@lucene.apache.org mailing list. > > I'm working for my owner, who can be reached > at java-user-ow...@lucene.apache.org. > > To confirm that you would like > >

Re: manually merging Directories

2014-12-29 Thread Michael McCandless
Why not use IW.addIndexes(Directory[])? Mike McCandless http://blog.mikemccandless.com On Mon, Dec 29, 2014 at 12:44 PM, Uwe Schindler wrote: > Hi, > > Why not simply leave each index directory on the searcher nodes as is: > Move all index directories (as mentioned by you) to a local disk and

[ANNOUNCE] Apache Lucene 4.10.3 released

2014-12-29 Thread Mark Miller
December 2014, Apache Luceneā„¢ 4.10.3 available The Lucene PMC is pleased to announce the release of Apache Lucene 4.10.3 Apache Lucene is a high-performance, full-featured text search engine library written entirely in Java. It is a technology suitable for nearly any application that requires ful

Re: manually merging Directories

2014-12-29 Thread Shaun Senecal
Hi Uwe, Ok, that's good to know. I thought each segment operated independently, so this may have been possible, but if there are inter-dependencies between the segments then its certainly not worth the trouble. I will scratch that off the list of possibilities. As you pointed out, doing th

RE: manually merging Directories

2014-12-29 Thread Uwe Schindler
Hi, Why not simply leave each index directory on the searcher nodes as is: Move all index directories (as mentioned by you) to a local disk and access them using a MultiReader - there is no need to merge them if you have not enough resources. If you have enough CPU and IO power, just merge them

Re: manually merging Directories

2014-12-29 Thread Shaun Senecal
I'm not worried about the I/O right now, I'm "hoping I can do better", that's all. It sounds like the only actual complication here is building the segments_N file, which would list all of the newly renamed segments, so perhaps this isn't impossible. That said, you're absolutely right about th