The index is non-compound format and optimized. Yes, I did try MMapDirectory, but the index is too big - 3.5 GB (1.3GB is term vectors)
Peter On 1/25/06, Doug Cutting <[EMAIL PROTECTED]> wrote: > > Peter Keegan wrote: > > This is just fyi - in my stress tests on a 8-cpu box (that's 8 real > cpus), > > the maximum throughput occurred with just 4 query threads. The query > > throughput decreased with fewer than 4 or greater than 4 query threads. > The > > entire index was most likely in the file system cache, too. Periodic > > snapshots of stack traces showed most threads blocked in the > synchronization > > in: FSIndexInput.readInternal(), when the thread count exceeded 4. > > Was this with a compound or non-compound format index? The non-compound > should fare slightly better, since there are more file handles per > index. Did you try using MMapDirectory? This should have no i/o > concurrency limits, but, on 32-bit systems, only works with indexes less > than a few GB. > > Doug > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [EMAIL PROTECTED] > For additional commands, e-mail: [EMAIL PROTECTED] > >
