>We are finding that the fetcher is crawling extremely slow. 

I am going to run some performance tests during this long weekend,
in-home network with Apache HTTPD, and with browsable copy of
www.apache.org 


1. Nutch-0.7.1 with protocol-http plugin

2. Nutch-0.7.1 with protocol-httpclient
 
2. Modified protocol-http plugin with added "Connection: close" before
Socket.close() (I suspect we overload Web Servers) 

3. with new plugin based on
http://www.innovation.ch/java/HTTPClient/advanced_info.html#pers_con,
with Keep-Alive

I'll publish results

-Fuad


Reply via email to