[Nutch-dev] Re: Update: HTTPClient for protocol-http and protocol-https

2005-05-17 Thread Andrzej Bialecki
Doug Cutting wrote: Andrzej Bialecki wrote: You can download the patch from here: http://www.getopt.org/nutch/20050507.patch I have not yet had a chance to try this. Following are some quick comments from reading the patch. Overall I think this is great stuff. 1. Why does an HTMLMetaTags n

[Nutch-dev] Re: Update: HTTPClient for protocol-http and protocol-https

2005-05-17 Thread Doug Cutting
Andrzej Bialecki wrote: You can download the patch from here: http://www.getopt.org/nutch/20050507.patch I have not yet had a chance to try this. Following are some quick comments from reading the patch. Overall I think this is great stuff. 1. Why does an HTMLMetaTags need to be passed to P

[Nutch-dev] Re: Update: HTTPClient for protocol-http and protocol-https

2005-05-08 Thread Piotr Kosiorowski
Hi Andrzej, I will try it out definitly. I had some attempts to using HttpClient with nutch ealier and while testing it on bigger crawls I found out one problem - http-client library logs some - not fatal from nutch point of view - errors on severe level (I think it was cyclic redirect or sth s