On Wed, 2008-06-18 at 07:17 -0700, Sebastin wrote: > I need to fetch approximately 225 GB of Index Store records in a web page > .the total time to fetch the record and display to the user takes 10 > minutes.is it possible to reduce the time to milliseconds
Depends on your indexes and your queries, but it shouldn't be impossible: Keep the searcher open between searches instead of starting from scratch every time and do warm up searches before the real ones. How many hits does a normal search return and what do you do with them? You might also consider the viability of that many indexes, as there is an upper limit to the number of available file handles. I guess it's system-specific, but on my machine it's around 1000 and since an active Lucene index uses more than one file handle, you might well hit the ceiling not far from your current number of searchers. All else failing, buy 4 * 64GB quality solid state drives, put them in RAID 0 and be happy. Lucene still needs to warm up on those, but nowhere near as much as conventional harddrives, and they are not as reliant on free RAM for disk-cache. --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
