From: "Ian Clarke" <[EMAIL PROTECTED]>
>...let's have search in Freenet
<snip>
I've been experimenting with spidering freesites, starting with the FProxy
Gateway page.
Some of the commercial windows spidering appz, like WebReaper (and others
which don't frig '//' to '/') are actually doing a good job crawling
Snarfoo, PigDog etc.
For you *nix-heads, why not try letting ht://dig loose on the Gateway.
That might be quite sufficient for search requirements.
Bear in mind that ht://dig might have to be hacked a tad to allow for
Freenet's long response times.
No prob though - ht://dig is open source.
Cheers
David
_______________________________________________
Devl mailing list
[EMAIL PROTECTED]
http://lists.freenetproject.org/mailman/listinfo/devl
