RE: GData, updateable IndexSearcher

2006-05-01 Thread Robert Engels
: GData, updateable IndexSearcher Thanks for the code and performance metric Robert. Have you had any issues with the deleted segments as Doug has been describing? - Original Message From: Robert Engels <[EMAIL PROTECTED]> To: java-dev@lucene.apache.org; jason rutherglen <[EMAIL

Re: GData, updateable IndexSearcher

2006-05-01 Thread jason rutherglen
y 1, 2006 11:49:41 AM Subject: RE: GData, updateable IndexSearcher Attached. It uses subclasses and instanceof which is sort of "hackish" - to do it correctly requires changes to the base classes. -Original Message- From: jason rutherglen [mailto:[EMAIL PROTECTED] Sent: Monday

RE: GData, updateable IndexSearcher

2006-05-01 Thread Robert Engels
Re: GData, updateable IndexSearcher Can you post your code? - Original Message From: Robert Engels <[EMAIL PROTECTED]> To: java-dev@lucene.apache.org; jason rutherglen <[EMAIL PROTECTED]> Sent: Monday, May 1, 2006 11:33:06 AM Subject: RE: GData, updateable IndexSearcher

Re: GData, updateable IndexSearcher

2006-05-01 Thread jason rutherglen
Can you post your code? - Original Message From: Robert Engels <[EMAIL PROTECTED]> To: java-dev@lucene.apache.org; jason rutherglen <[EMAIL PROTECTED]> Sent: Monday, May 1, 2006 11:33:06 AM Subject: RE: GData, updateable IndexSearcher fyi, using my reopen(0 implementation (w

RE: GData, updateable IndexSearcher

2006-05-01 Thread Robert Engels
Message- From: jason rutherglen [mailto:[EMAIL PROTECTED] Sent: Monday, May 01, 2006 1:24 PM To: java-dev@lucene.apache.org Subject: Re: GData, updateable IndexSearcher I wanted to post a quick hack to see if it is along the correct lines. A few of the questions regard whether to resuse

Re: GData, updateable IndexSearcher

2006-05-01 Thread jason rutherglen
I wanted to post a quick hack to see if it is along the correct lines. A few of the questions regard whether to resuse existing MultiReaders or simply strip out only the SegmentReaders. I do a compare on the segment name and made it public. Thanks! public static IndexReader reopen(IndexRead

Re: GData, updateable IndexSearcher

2006-04-29 Thread Yonik Seeley
On 4/28/06, Doug Cutting <[EMAIL PROTECTED]> wrote: Another complication is determining whether deletions have changed. We don't have a per-segment version number. We could either add a version to the segment (perhaps even in the deletions file) Deletions (.del) --> ByteCount,BitCount,Bits By

Re: GData, updateable IndexSearcher

2006-04-28 Thread Doug Cutting
Vanlerberghe, Luc wrote: So if you want to implement reopen() of a segment, you should be fine by just reloading the .del file in memory for that segment (while holding the commit lock of course). Correct. However if Filters were cached based on the IndexReader (as is standard) then these fil

RE: GData, updateable IndexSearcher

2006-04-27 Thread Vanlerberghe, Luc
EMAIL PROTECTED] Sent: donderdag 27 april 2006 20:30 To: java-dev@lucene.apache.org; [EMAIL PROTECTED] Subject: Re: GData, updateable IndexSearcher On 4/27/06, Robert Engels <[EMAIL PROTECTED]> wrote: > I thought each segment maintained its own list of deleted documents Right. > (since s

Re: GData, updateable IndexSearcher

2006-04-27 Thread Yonik Seeley
On 4/27/06, Robert Engels <[EMAIL PROTECTED]> wrote: > I thought each segment maintained its own list of deleted documents Right. > (since segments are WRITE ONCE Yes, but deletions are the exception to that rule. Once written, segment files never change, except for the file that tracks deleted

RE: GData, updateable IndexSearcher

2006-04-27 Thread Robert Engels
ay be "unstable". -Original Message- From: Doug Cutting [mailto:[EMAIL PROTECTED] Sent: Wednesday, April 26, 2006 3:44 PM To: java-dev@lucene.apache.org Subject: Re: GData, updateable IndexSearcher jason rutherglen wrote: > I was thinking you implied that you knew of someone

Re: GData, updateable IndexSearcher

2006-04-27 Thread jason rutherglen
dnesday, April 26, 2006 1:44:08 PM Subject: Re: GData, updateable IndexSearcher jason rutherglen wrote: > I was thinking you implied that you knew of someone who had customized their > own, but it was a closed source solution. And if so then you would know how > that project faired.

Re: GData, updateable IndexSearcher

2006-04-26 Thread Chuck Williams
Message >> From: Doug Cutting <[EMAIL PROTECTED]> >> To: solr-dev@lucene.apache.org >> Sent: Wednesday, April 26, 2006 11:27:44 AM >> Subject: Re: GData, updateable IndexSearcher >> >> jason rutherglen wrote: >> >>> Interesting, does this

Re: GData, updateable IndexSearcher

2006-04-26 Thread Doug Cutting
. Doug - Original Message From: Doug Cutting <[EMAIL PROTECTED]> To: solr-dev@lucene.apache.org Sent: Wednesday, April 26, 2006 11:27:44 AM Subject: Re: GData, updateable IndexSearcher jason rutherglen wrote: Interesting, does this mean there is a plan for incrementally updateable I

Re: GData, updateable IndexSearcher

2006-04-26 Thread Yonik Seeley
On 4/26/06, jason rutherglen <[EMAIL PROTECTED]> wrote: > As this would be used with Solr I wonder if there would be a good way to also > update the Solr caches. Other than re-executing queries that generated the results? Probably not. The nice thing about knowing exactly when the view of an inde

Re: GData, updateable IndexSearcher

2006-04-26 Thread jason rutherglen
ginal Message From: Doug Cutting <[EMAIL PROTECTED]> To: solr-dev@lucene.apache.org Sent: Wednesday, April 26, 2006 11:27:44 AM Subject: Re: GData, updateable IndexSearcher jason rutherglen wrote: > Interesting, does this mean there is a plan for incrementally updateable > IndexSearchers