302 does get recognized as a redirection, yes
On Fri, May 28, 2021 at 5:07 AM ritika jain
wrote:
> Is the process the same when fetch/process status code returned is 302 ?
When running a job with web crawler and ES output connector
>>>
> can anybody have a clue about this
>
>
> Is the process the same when fetch/process status code returned is 302 ?
>>> When running a job with web crawler and ES output connector
>>>
>>
can anybody have a clue about this
Is the process the same when fetch/process status code returned is 302 ?
When running a job with web crawler and ES output connector
On Wed, May 19, 2021 at 10:35 PM Karl Wright wrote:
> ManifoldCF reads all the URLs on its queue.
> If it's a 301, it detects this and pushes the new URL onto
ManifoldCF reads all the URLs on its queue.
If it's a 301, it detects this and pushes the new URL onto the document
queue.
When it gets to the new URL, it processes it like any other.
Karl
On Wed, May 19, 2021 at 8:32 AM ritika jain
wrote:
> Hi
>
> I want to understand the process of "How
Hi
I want to understand the process of "How does manifold.cf handles
redirection of URL." in case of web crawler connector
If there is a page redirect (through a 301) to another URL, then the next
crawl will detect the redirect and index the new (final) URL and display it
in the search results.
