On Tuesday, October 5, 2004, 11:27:04 AM, Daniel Quinlan wrote: > Jeff Chan <[EMAIL PROTECTED]> writes:
>> Can anyone recommend software to crawl DMOZ, wikipedia, etc., to >> grab the URIs? > Gack!!! You don't want to crawl any of those to grab URLs. Just > download a dump of the database. Yep, noticed they have dumps available: http://rdf.dmoz.org/ and am processing. Jeff C. -- Jeff Chan mailto:[EMAIL PROTECTED] http://www.surbl.org/
