Distributed vs Merged Searching

2006-01-31 Thread Chun Wei Ho
I am deploying a web application serving searches on a Lucene index, and am deciding between distributing search between several machines or single searching, and was hoping that someone could tell me from their experiences: + Is there anything particular to watch out for if using distributed sear

Re: Distributed vs Merged Searching

2006-02-01 Thread Grant Ingersoll
You might find http://hellonline.com/blog/?p=55 helpful. It discusses some issues with parallel distributed searches and may be helpful. How many documents are you expecting to index? And how many unique terms do you expect? Chun Wei Ho wrote: I am deploying a web application serving searc

Re: Distributed vs Merged Searching

2006-02-01 Thread Chris Lamprecht
One issue is that if you are splitting the index in half (for example), getting some results from index A and some from index B, then you need to merge the results somewhere. But the scores coming from the two indexes are not related at all, for example, document 100 from index A has score 0.85, d

Re: Distributed vs Merged Searching

2006-02-01 Thread Andrzej Bialecki
Chris Lamprecht wrote: One issue is that if you are splitting the index in half (for example), getting some results from index A and some from index B, then you need to merge the results somewhere. But the scores coming from the two indexes are not related at all, for example, document 100 from