hello all, sorry for my second mail but I've got one further problem with nutch 0.7.1:
I am using 5 parallel fetchers. I generate the segments for the fetchers with "generate db segments -topN 5000 -numFetchers 5". The first crawls all went fine, every fetcher fetched around 1000 urls, but after rounds of crawling, only 1 of the 5 generated segments/fetchlists contained urls (about 5000). the fetchlists of all other segments where empty. Is this a bug/feature/... ? Which rules does the generate tool follow when dividing urls into segments ?
thanks for your help again :) Thimo ------------------------------------------------------- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://ads.osdn.com/?ad_id=7637&alloc_id=16865&op=click _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
