[
https://issues.apache.org/jira/browse/NUTCH-277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrzej Bialecki closed NUTCH-277.
-----------------------------------
Resolution: Cannot Reproduce
Fix Version/s: 0.9.0
Assignee: Andrzej Bialecki
Cannot reproduce this. If the problem reappears please create a new issue.
> Fetcher dies because of "max. redirects" (avoiding infinite loop)
> -----------------------------------------------------------------
>
> Key: NUTCH-277
> URL: https://issues.apache.org/jira/browse/NUTCH-277
> Project: Nutch
> Issue Type: Bug
> Components: fetcher
> Affects Versions: 0.8
> Environment: nightly-2006-05-20
> Reporter: Stefan Neufeind
> Assigned To: Andrzej Bialecki
> Priority: Critical
> Fix For: 0.9.0
>
>
> Error in the logs is:
> 060521 213401 SEVERE Narrowly avoided an infinite loop in execute
> org.apache.commons.httpclient.RedirectException: Maximum redirects (100)
> exceeded
> at
> org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:183)
> at
> org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:396)
> at
> org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:324)
> at
> org.apache.nutch.protocol.httpclient.HttpResponse.<init>(HttpResponse.java:87)
> at org.apache.nutch.protocol.httpclient.Http.getResponse(Http.java:97)
> at
> org.apache.nutch.protocol.http.api.RobotRulesParser.isAllowed(RobotRulesParser.java:394)
> at
> org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.java:173)
> at
> org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:135)
> This happens during normal crawling. Unfortunately I don't know how to
> further track this down. But it's problematic, since it actually makes the
> fetcher die.
> Workaround (for the symptom) is in NUTCH-258 (avoid dying on SEVERE
> logentry). That works for me, crawling works fine and it does not hang/crash.
> However this is working around the problems not solving them - I know. But
> it helps for the moment ...
> Hope somebody can help - this loops quite important to track down to me.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Nutch-developers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-developers
