WebCrawler Connector code

2020-07-06 Thread ritika jain
Hi All, I have confusion regarding WebCrawler connector code.My requirement is to abort a job whenever a seed-corresponding site is down or returning some 5xx response codes. So I have used the jobManager errorAbort method for this in addSeedDocuments method of Webcrawlerconnector.java..,

Re: WebCrawler Connector code

2020-07-06 Thread Karl Wright
Hi Ritika, ' My requirement is to abort a job whenever a seed-corresponding site is down or returning some 5xx response codes. ' (1) Connector methods, like addSeedDocuments(), are called by the framework. You do not call them yourself when you write a connector. So you are looking in the