On Wednesday 27 September 2006 18:51, Erik Hatcher wrote:
> Lots of possible issues, but we need more information to troubleshoot
> this properly.
> How big is your index, number of documents?
CDs 137,390
DVDs 41,049
Games 3,360
Books 648,941
Total 830,740
> total file system size of the index?
segments 31b
deletable 4b
index 286Mb
> is your index optimized?
Yes, after every 1000 adds
> how often do you update the index?
Continuously. We have document builders running for each product type. They
pull all products of their type which have changed since their last index
time, build the documents and stick them in a queue for the indexer (this
includes deletes), sleep for an hour and repeat. The indexer processes the
queue optimising the index every 1000 documents.
> how are you managing indexsearcher instances after the index is updated?
My main search class is a Runnable, in it's run method it does the following.
while( !this.stop ) {
try {
Thread.sleep( 1000 * 60 * 5 );
this.indexSearcher =
new IndexSearcher(
new RAMDirectory(
FSDirectory.getDirectory(
this.index_directory, true
)
)
)
);
} catch( IOException e ) {
log.severe( "Failed to reload the searcher" );
} catch( InterruptedException e ) {
log.notice( "Index reloading interrupted" );
}
}
I have replied to the other message in this thread with the questions asked
there as well.
Many Thanks
Rob
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]