On Wed, Aug 26, 2009 at 10:34 AM, Ken Krugler<[email protected]> wrote: > If the sites you are crawling are under your control, or you have an > understanding with the site ops people, then you can alter Nutch's default > settings to make it run at near full speed.
What settings would those be? I tried increasing the number of threads from 10 to 125, but it had absolutely no discernible effect on the crawl speed. -- http://www.linkedin.com/in/paultomblin
