MultiThreadedTaskMaster stops on HTTP error code 404
----------------------------------------------------
Key: DROIDS-146
URL: https://issues.apache.org/jira/browse/DROIDS-146
Project: Droids
Issue Type: Bug
Components: core
Affects Versions: 0.0.2
Reporter: Tobias Rübner
Fix For: 0.0.2
Crawling a site and getting a HTTP error >= 400 the MultiThreadedTaskMaster
stops the process.
{code}
1:12:27.312 [pool-1-thread-1] ERROR org.apache.droids.AbstractDroid -
org.apache.http.client.HttpResponseException: Not Found
at
org.apache.droids.protocol.http.HttpProtocol.load(HttpProtocol.java:71)
~[droids-core-0.2-incubating-SNAPSHOT.jar:0.2-incubating-SNAPSHOT 1146608 -
truebner]
at
org.apache.droids.robot.crawler.CrawlingWorker.execute(CrawlingWorker.java:72)
~[droids-core-0.2-incubating-SNAPSHOT.jar:0.2-incubating-SNAPSHOT 1146608 -
truebner]
at
org.apache.droids.robot.crawler.CrawlingWorker.execute(CrawlingWorker.java:39)
~[droids-core-0.2-incubating-SNAPSHOT.jar:0.2-incubating-SNAPSHOT 1146608 -
truebner]
at
org.apache.droids.impl.MultiThreadedTaskMaster$TaskExecutor.run(MultiThreadedTaskMaster.java:335)
~[droids-core-0.2-incubating-SNAPSHOT.jar:0.2-incubating-SNAPSHOT 1146608 -
truebner]
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
[na:1.6.0_24]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
[na:1.6.0_24]
at java.lang.Thread.run(Thread.java:662) [na:1.6.0_24]
{code}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira