SimpleTaskQueue is very slow to init when there is a large number of seed URLs
------------------------------------------------------------------------------
Key: DROIDS-47
URL: https://issues.apache.org/jira/browse/DROIDS-47
Project: Droids
Issue Type: Improvement
Components: core
Affects Versions: 0.01
Reporter: Mingfai Ma
when i put 300,000 seeds url to CrawlingDroid with SimpleTaskQueueWithHistory
and init() it, it takes an hour to complete on my Quad core server.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
