On Tue, Sep 2, 2008 at 2:43 AM, Florent Daigni?re <nextgens at freenetproject.org> wrote: > * Evan Daniel <evanbd at gmail.com> [2008-09-01 22:35:07]: > >> On Mon, Sep 1, 2008 at 4:43 PM, Matthew Toseland >> <toad at amphibian.dyndns.org> wrote: >> >> > Searching: Lots of users want searching, and are disappointed when they >> > don't >> > get it. Integrating XMLLibrarian into freesites and into the homepage would >> > help; making XMLSpider easier to use might help too; in any case, we need >> > somebody to regularly insert an index. >> >> At present the spider doesn't work. I'm happy to run it for testing, >> but probably won't run it for a public index (I'd want to run it >> anonymously). See https://bugs.freenetproject.org/view.php?id=2350 >> for details. Short version: after some time, the spider stalls with a >> queue full or queries that neither complete nor fail. >> > > I have changed how callbacks are handled in previous stable; can you > still reproduce it with builds post 1158?
The behavior is unchanged with build 1160. The quickest way to verify is to recompile the spider with maxParallelRequests = 1. After a little while it should get stuck with a request in the queue that never completes or finishes. (It took a few minutes to stall here, with 800 completed requests and 50 failed.) Evan Daniel
