Do you see any chance to preprocess (e.g. presort) data may until fetching where i/o istn't 100% used to improve processes later?
If your disk is underutilized then you can simply run updatedb one one segment while fetching another segment.
What speaks against made all releated code as a plugin as well so people with a small installation can use this implementation and people with a larger nutch installation can use a other implementation?
I don't have a problem with that.
Doug
------------------------------------------------------- This SF.Net email is sponsored by: Sybase ASE Linux Express Edition - download now for FREE LinuxWorld Reader's Choice Award Winner for best database on Linux. http://ads.osdn.com/?ad_id=5588&alloc_id=12065&op=click _______________________________________________ Nutch-developers mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-developers
