Jeff Chan <[EMAIL PROTECTED]> writes: > Can anyone recommend software to crawl DMOZ, wikipedia, etc., to > grab the URIs?
Gack!!! You don't want to crawl any of those to grab URLs. Just download a dump of the database. Daniel -- Daniel Quinlan ApacheCon! 13-17 November (3 SpamAssassin http://www.pathname.com/~quinlan/ http://www.apachecon.com/ sessions & more)
