Re: Crawling pages behind SSO authentication (SAML/OIDC)

memory: "3000Mi" On Thu, Jul 1, 2021 at 3:06 PM Lewis John McGibbney wrote: > Hi Abhay, > > On 2021/06/10 22:27:42, Abhay Ratnaparkhi > wrote: > > > > > Based on selenium I created a microservice (which handles all required > SSO > > redirection

Re: Crawling pages behind SSO authentication (SAML/OIDC)

please take that info consideration. > > Your note regarding the time it takes for the 'chaining' of systems > together to achieve the login is well made. This was easily observed and > needs a more consolidated/calculated approach IMHO. > > I would be interested to discuss this fu

Crawling pages behind SSO authentication (SAML/OIDC)

isn't required) Thank you Abhay Ratnaparkhi

Re: Nutch getting rid of older segments

case websites change layout, or are no > longer customer and not being crawled anymore. > > Regards, > Markus > > Op di 6 apr. 2021 om 21:54 schreef Abhay Ratnaparkhi < > abhay.ratnapar...@gmail.com>: > > > Hello, > > > > I have a large number of segm

Nutch getting rid of older segments

Hello, I have a large number of segments occupying disk space. It is a good strategy to delete old segments or it's better to merge them. Thank you Abhay

Re: Nutch Configure multiple fetch plugins

; Markus > > > > Op vr 2 apr. 2021 om 15:18 schreef Abhay Ratnaparkhi < > abhay.ratnapar...@gmail.com>: > > > Hello, > > > > I would like to know how to configure multiple fetch plugins (like > > protocol-selenium for dynamic and protocol-http for sta

Nutch Configure multiple fetch plugins

Hello, I would like to know how to configure multiple fetch plugins (like protocol-selenium for dynamic and protocol-http for static content)? I remember seeing this feature before but could't find it. Thank you ~Abhay

Re: Java Script UI for solr search..

You can call solr REST API endpoint using any javascript framework. We put one more API layer inbetween solr and UI so that we can have some of our own changes (like interleaving etc) It