Re: Optimizing search speed & performance for a 10G Index.

2006-12-08 Thread Erick Erickson
Other questions besides Grants... What is the overall response time? If your overall response time is 10 seconds, tuning Lucene won't help you much. Are you re-opening a searcher each time? This is bad. How many documents are you finding and are you iterating over a Hits object for more than 10

Re: Optimizing search speed & performance for a 10G Index.

2006-12-08 Thread Grant Ingersoll
Have you done any profiling of your application yet to identify bottlenecks (i.e. are you sure it is Lucene)? Without some profiling, you really will just be guessing. Also, search this and the dev. list for performance, as there have been many lengthy discussions in the past on optimizat

Optimizing search speed & performance for a 10G Index.

2006-12-07 Thread Chun Wei Ho
Hi, We run a search engine based on Lucene 1.9.1 / Nutch 0.7.2. Our index has approximately 2 million documents and the physical size of it is about 10 GB. We run it as a tomcat web application on a Fedora Core 4 server with duo Xeon 3.2GHz processors and 4GB RAM. We receive about 46500 web sear