Hi,
On 6/4/07, Doug Cutting [EMAIL PROTECTED] wrote:
Does the 0.9 crawl-delay implementation actually permit multiple threads
to access a site simultaneously?
AFAIK, yes. Option fetcher.threads.per.host should be greater than 1
_only_ when you are accessing a site under your control. So, all
Does the 0.9 crawl-delay implementation actually permit multiple threads
to access a site simultaneously?
Doug
Original Message
Subject: Nutch 0.9 and Crawl-Delay
Date: Sun, 3 Jun 2007 10:50:24 +0200
From: Lutz Zetzsche [EMAIL PROTECTED]
Reply-To: [EMAIL PROTECTED]
To: [EMAIL
