[
https://issues.apache.org/jira/browse/NUTCH-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yogendra Kumar Soni updated NUTCH-2134:
---------------------------------------
Description: fetcher thread is handling redirection logic and it is failing
where redirection 301 takes to some other domain and get authentication cookies
from there and again redirects to same url with cookies (even if domain is in
urlfilter). HttpClient 4.5 uses automatic redirection handling with cookies,
which is working well. In place of handling redirects in fetcherThread we can
enable user to use HTTPclients 4.5 redirection handling. In other words enable
redirection handling logic selection using HttpBase or protocol plugin. (was:
fetcher thread is handling redirection logic and it is failing where
redirection 301 takes to some other domain and get authentication cookies from
there and again redirects to same url with cookies (even if domain is in
urlfilter). HttpClient 4.5 uses automatic redirection handling with cookies,
which is working well. In place of handling redirects in fetcherThread we can
enable user to use HTTPclients 4.5 redirection handling. In other words enable
redirection handling logic selection of fetcher or plugin.)
> Redirection and cookie handling using protocol plugins
> -------------------------------------------------------
>
> Key: NUTCH-2134
> URL: https://issues.apache.org/jira/browse/NUTCH-2134
> Project: Nutch
> Issue Type: Improvement
> Components: fetcher, plugin, protocol
> Affects Versions: 1.11
> Reporter: Yogendra Kumar Soni
> Priority: Minor
>
> fetcher thread is handling redirection logic and it is failing where
> redirection 301 takes to some other domain and get authentication cookies
> from there and again redirects to same url with cookies (even if domain is in
> urlfilter). HttpClient 4.5 uses automatic redirection handling with cookies,
> which is working well. In place of handling redirects in fetcherThread we can
> enable user to use HTTPclients 4.5 redirection handling. In other words
> enable redirection handling logic selection using HttpBase or protocol plugin.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
