Hi Stefan, thanks for these hints.
We could now download segements with 5000000 pages with the following values:
36.32834 pages/s, 4005.9265 kb/s, 14114.563 bytes/page (own dns, 500 fetchers on a 2.4 GHz system with 512 MB RAM) Great, thanks again. Matthias ------------------------------------------------------- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477&alloc_id=16492&op=click _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
