Hi I want to understand the process of "How does manifold.cf handles redirection of URL." in case of web crawler connector
If there is a page redirect (through a 301) to another URL, then the next crawl will detect the redirect and index the new (final) URL and display it in the search results. (instead of the old URL that redirects). Just as is also done by search engines like Google / Bing. Is that true, , what manifold is capable of avoiding the URL that is 301 and pick the URL to which it is redirected? and ingest that URL . If not , what process Manifoldcf follows to inges redirection of URL's Thanks Ritika
