Hello, Is there a way to configure Nutch to crawl "forms authenticated" websites? What I mean is the kind of websites which look up a database for authentication/authorization and does not allow you to view secure pages unless authenticated. This need not be specifically on https, but on http too..!
Any help is greatly appreciated. Thanks, Ranganath P.S : Not sure if this is the right email to ask the question. Apologies, in advance.