* NDFS is _NOT_ suitable for distributing the search indexes, and running search servers on indexes that are put on NDFS will kill the performance. Searching requires a fast local access to the index files.
I don't entirely agree with this. I think we should implement a Lucene Directory that can read indexes that are stored in NDFS. (A read-only Directory implementation would suffice.) This may not perform well for all applications, but I think it would be very useful. For example, it would be good to be able to keep segment indexes in a reliable storage system along with other segment data. And it would be good to be able to perform test searches, duplicate elimination, etc. w/o copying indexes to local storage. And there may be low-query-volume applications where it may always be appropriate for the indexes to reside in NDFS.
Doug
------------------------------------------------------- This SF.net email is sponsored by: IT Product Guide on ITManagersJournal Use IT products in your business? Tell us what you think of them. Give us Your Opinions, Get Free ThinkGeek Gift Certificates! Click to find out more http://productguide.itmanagersjournal.com/guidepromo.tmpl _______________________________________________ Nutch-developers mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-developers
