Again I thank you Sebastian! I was able to resolve the issue by updating the HTTPClient library. I also updated from Nutch 1.11 to 1.14 and had no issue with the SSL.
Best, ...bob On Tue, Mar 20, 2018 at 5:03 PM, Sebastian Nagel <wastl.na...@googlemail.com > wrote: > Hi Robert, > > although the error message differs, somewhat resembles > https://issues.apache.org/jira/browse/NUTCH-2447 > > I've tried to reproduce it using Nutch 1.11, but it works > with Java 8 on Ubuntu 16.04. Sorry, I have no glue where even > to start searching for the reason. > > Best, > Sebastian > > > On 03/20/2018 09:00 PM, Robert Scavilla wrote: > > Thank you Sebastian! I am still working on the issue. I tested the cert > > using openssl and also got the same handshake failure. After further > > checking I found that the openssl command works when I add the > -servername > > option. So apparently, my nutch server (Fedora 27) requires SNI. I added > > -Djsse.enableSNIExtension=false and true to NUTCH_OPTS but still no > > success. > > > > Is there anything else you can think of to allow nutch to work around > the > > SNI issue? > > > > Thank you in advance for your help, > > ...bob > > > > > > On Tue, Mar 20, 2018 at 3:31 AM, Sebastian Nagel < > wastl.na...@googlemail.com > >> wrote: > > > >> Hi Robert, > >> > >> unfortunately, I'm not able to reproduce the problem. > >> Fetching works with the recent 1.x and Java 8, I've tried both: > >> > >> bin/nutch parsechecker -Dplugin.includes='protocol-http|parse-html' > >> https://potomac.edu/ > >> > >> bin/nutch parsechecker -Dplugin.includes='protocol- > httpclient|parse-html' > >> https://potomac.edu/ > >> > >> Best, > >> Sebastian > >> > >> > >> On 03/20/2018 12:49 AM, Robert Scavilla wrote: > >>> Hi, I'm stuck on this problem and would appreciate any help. I'm using > >>> nutch 1.11 > >>> plugin-includes: > >>> <value>protocol-http|urlfilter-regex.... > >>> > >>> Running indexchecker generates error for only one site: > >>>> apache-nutch-1.11/runtime/local/bin/nutch indexchecker > >> https://potomac.edu/ > >>> > >>> Error message: > >>> httpclient.Http - Failed to get protocol output > >>> javax.net.ssl.SSLHandshakeException: Received fatal alert: > >> handshake_failure > >>> > >>> I've manually added certificate in cacerts file > >>> > >>> I'm out of ideas - thank you for helping, > >>> ...bob > >>> > >> > >> > > > >
