RE: Acedemic Question About Indexing

2004-11-11 Thread Will Allen
11:37 AM To: Lucene Users List Cc: Will Allen Subject: Re: Acedemic Question About Indexing Will, could you give more details about your architecture? -each time update o create new indexes -data stored at each index etc. because it is quite interesting, and I would like to test it. Sodel

Re: Acedemic Question About Indexing

2004-11-11 Thread Gard Arneson Haugen
indexing 1/6 of that total data reducing the time it takes to index by about 5X. -Original Message- From: Luke Shannon [mailto:[EMAIL PROTECTED] Sent: Wednesday, November 10, 2004 2:39 PM To: Lucene Users List Subject: Re: Acedemic Question About Indexing Don't worry, regardless of w

Re: Acedemic Question About Indexing

2004-11-11 Thread Luke Shannon
; <[EMAIL PROTECTED]> Sent: Wednesday, November 10, 2004 7:23 PM Subject: RE: Acedemic Question About Indexing I have an application that I run monthly that indexes 40 million documents into 6 indexes, then uses a multisearcher. The advantage for me is that I can have multiple writers indexing

RE: Acedemic Question About Indexing

2004-11-10 Thread Will Allen
Shannon [mailto:[EMAIL PROTECTED] Sent: Wednesday, November 10, 2004 2:39 PM To: Lucene Users List Subject: Re: Acedemic Question About Indexing Don't worry, regardless of what I learn in this forum I am telling my company to get me a copy of that bad boy when it comes out (which as far as

Re: Acedemic Question About Indexing

2004-11-10 Thread Luke Shannon
o multi threaded indexing territory? Thanks, Luke - Original Message - From: "Otis Gospodnetic" <[EMAIL PROTECTED]> To: "Lucene Users List" <[EMAIL PROTECTED]> Sent: Wednesday, November 10, 2004 2:08 PM Subject: Re: Acedemic Question About Indexing > Uh, I

Re: Acedemic Question About Indexing

2004-11-10 Thread Otis Gospodnetic
Uh, I hate to market it, but it's in the book. But you don't have to wait for it, as there already is a Lucene demo that does what you described. I am not sure if the demo always recreates the index or whether it deletes and re-adds only the new and modified files, but if it's the former, you