I'm trying to crawl three tiny little sites with Nutch, and it takes 45 minutes. To copy the same files to my local hard drive using wget takes between 35 seconds and a minute. What is Nutch doing that causes it to take 45 times as long?
-- http://www.linkedin.com/in/paultomblin
