RE: Searching on a Rapidly changing Index

2007-05-24 Thread Mordo, Aviran (EXP N-NANNATEK)
You can create two indexes. One will be for new documents, let say the last 24 hours and another one for older documents. This way you will only update a small portion of your index while the large index will remain relatively constant so you don't have to get a new searcher for it. HTH Aviran ht

Re: Searching on a Rapidly changing Index

2007-05-24 Thread Erick Erickson
Another option would be to only re-open your searcher when actually needed, that is after the index has changed. This only does you some good when you have some hope that there are sizable gaps in your modifications Another possibility is to relax the "immediately" constraint. Would a maximum

Re: Searching on a Rapidly changing Index

2007-05-24 Thread Simon Wistow
On Thu, May 24, 2007 at 09:28:30AM -0400, Erick Erickson said: > If that's unacceptable, you can *still* open up a new reader in the > background and warm it up before using it. "immediately" then > becomes 5-10 seconds or so. This is currently what I'm doing using a list of previous performed qu

Re: Searching on a Rapidly changing Index

2007-05-24 Thread Joe Shaw
Hi, On 5/24/07, Erick Erickson <[EMAIL PROTECTED]> wrote: If that's unacceptable, you can *still* open up a new reader in the background and warm it up before using it. "immediately" then becomes 5-10 seconds or so. I've seen the term "warming" used a few times on the various lists. What const

Re: Searching on a Rapidly changing Index

2007-05-24 Thread Erick Erickson
Yep. You probably want to do some sorting by other than relevancy too in order to fill the sort caches. Erick On 5/24/07, Joe Shaw <[EMAIL PROTECTED]> wrote: Hi, On 5/24/07, Erick Erickson <[EMAIL PROTECTED]> wrote: > If that's unacceptable, you can *still* open up a new reader in the > b

Re: Searching on a Rapidly changing Index

2007-05-26 Thread Yonik Seeley
On 5/24/07, Joe Shaw <[EMAIL PROTECTED]> wrote: On 5/24/07, Erick Erickson <[EMAIL PROTECTED]> wrote: > If that's unacceptable, you can *still* open up a new reader in the > background and warm it up before using it. "immediately" then > becomes 5-10 seconds or so. I've seen the term "warming" u