While building a large index, we had a power outage. Over 2 million
documents had been added, each document with up to about 20 fields. The
size of the index on disk is ~500MB. When I started the process up again, I
noticed that documents that should have been in the index were missing. In
February 19, 2006 5:06:42 PM
Subject: Index missing documents
While building a large index, we had a power outage. Over 2 million
documents had been added, each document with up to about 20 fields. The
size of the index on disk is ~500MB. When I started the process up again, I
noticed that
Thanks Otis. All the documents were written in a using the same
IndexWriter, without ever closing it. Is this what could be responsible for
the documents not being in the segmens file, or is this bad practice? Maybe
I should use a writer for a batch of documents (1000 or so maybe?), and then
ocess will be slower.
Otis
- Original Message
From: Michael van Rooyen <[EMAIL PROTECTED]>
To: java-user@lucene.apache.org; Otis Gospodnetic <[EMAIL PROTECTED]>
Sent: Monday, February 20, 2006 3:20:22 AM
Subject: Re: Index missing documents
Thanks Otis. All the documents
nt: Monday, February 20, 2006 8:39 PM
Subject: Re: Index missing documents
No, using the same IndexWriter is the way to go. If you want things to be
written to disk more frequently, lower the maxBufferedDocs setting. Go
down to 1, if you want. You'll use less memory (RAM), Documents will
