Folks, I've went ahead and added the following comment in nutch-default.xml:
" In order to use HTTPS please enable protocol-httpclient, but be aware of possible intermittent problems with the underlying commons-httpclient library." Hopefully this will help folks in the future with this. Thanks! Cheers, Chris On 1/24/07 3:29 PM, "Chris Mattmann" <[EMAIL PROTECTED]> wrote: > Hi Guys, > > Yep, I couldn't remember exactly what the issues were. Thanks for digging > that up, Andrzej. So, yeah, anyways it may make sense to update > nutch-site.xml with the comment below, with "performance problems" replaced > with "intermittent problems with the underlying commons-httpclient library". > > If you guys agree, I'll add the comment to nutch-site... > > Cheers, > Chris > > > > On 1/24/07 3:10 PM, "Andrzej Bialecki" <[EMAIL PROTECTED]> wrote: > >> Michael Wechner wrote: >>> ok. So what about adding a comment to nutch-site.xml, e.g. >>> >>> <!-- NOTE: In order to use https please add protocol-httpclient, but >>> be aware of possible performance problems! --> >> >> They were not performance problems. There were some issues related to >> using multiple threads, which would sometimes cause the httpclient >> library to fail. There was also a logging message produce in the >> internals of httpclient that was difficult to turn off - but now that we >> are using log4j this should be straightforward. There was a bug in >> chunked encoding handling that would cause hangs. >> >> There were also other intermittent problems with this library, so after >> much deliberation we decided to leave the simpler plugin as the default ... >> >> These issues may have been solved in a newer version of httpclient library. > > ______________________________________________ > Chris A. Mattmann > [EMAIL PROTECTED] > Staff Member > Modeling and Data Management Systems Section (387) > Data Management Systems and Technologies Group > > _________________________________________________ > Jet Propulsion Laboratory Pasadena, CA > Office: 171-266B Mailstop: 171-246 > _______________________________________________________ > > Disclaimer: The opinions presented within are my own and do not reflect > those of either NASA, JPL, or the California Institute of Technology. > > ------------------------------------------------------------------------- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
