Lucene _can_ load the index into memory, but it doesn't have to, if you
want further details see the Javadocs on RAMDirectory versus
FSDirectory. I think you will find it has good performance on a few
gigs of data. Results, of course, vary based on what you are asking it
to do and what kind of hardware you have.
-Grant
Xiaocheng Luan wrote:
Hi,
I heard that Lucene loads the index into memory to do a search, which does not sound quite right to me. I will not be surprised if Lucene is smart enough to load
the index into memory when it is feasible, but I'd be surprised if it ALWAYS
loads index memory to do the search, which I think would have scalability
problem.
Could someone clarify on this, thanks!
By the way, could someone please share some experience on the performance of Lucene, say, on a data set of a few gigabytes and a "reasonable" query, what would
be the average search time?
Xiaocheng
---------------------------------
Yahoo! Mail
Use Photomail to share photos without annoying attachments.
--
-------------------------------------------------------------------
Grant Ingersoll
Sr. Software Engineer
Center for Natural Language Processing
Syracuse University
School of Information Studies
335 Hinds Hall
Syracuse, NY 13244
http://www.cnlp.org
Voice: 315-443-5484
Fax: 315-443-6886
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
