>From [EMAIL PROTECTED] Fri Nov 10 14: 47:29 2000 Received: by mccmedia.com from localhost (router,SLMail V2.7); Fri, 10 Nov 2000 14:47:29 -0800 Received: by mccmedia.com from mail2 (209.133.89.19::mail daemon; unverified,SLMail V2.7); Fri, 10 Nov 2000 14:47:26 -0800 Received: from MAIL2.MCCMEDIA.COM by MAIL2.MCCMEDIA.COM (LISTSERV-TCP/IP release 1.8c) with spool id 35331 for [EMAIL PROTECTED]; Fri, 10 Nov 2000 14:39:44 -0800 Received: by mccmedia.com from localhost (router,SLMail V2.7); Fri, 10 Nov 2000 14:42:04 -0800 Received: by mccmedia.com from searchtools.com (157.22.1.144::mail daemon; unverified,SLMail V2.7); Fri, 10 Nov 2000 14:42:01 -0800 Received: by searchtools.com (Stalker Internet Mail Server 1.8b7) with FILE id S.0000025730 for <[EMAIL PROTECTED]>; Fri, 10 Nov 2000 15:37:56 -0700 Received: from [171.66.196.146] (POP-user avi-list) by searchtools.com (Stalker POP3 Server 1.8b7) with POP/XMIT id S.0000025729; Fri, 10 Nov 2000 15:37:52 -0700 Mime-Version: 1.0 References: <[EMAIL PROTECTED]> <p04310103b4eae66b4370@[171.66.196.146]> Content-Type: text/plain; charset=us-ascii; format=flowed Message-ID: <p0510021cb63225c3ac1f@[171.66.196.146]> Date: Fri, 10 Nov 2000 14:28:08 -0800 Reply-To: [EMAIL PROTECTED] Sender: [EMAIL PROTECTED] From: Avi Rappoport <[EMAIL PROTECTED]> Subject: anyone want to license their robot spider for search? Comments: To: [EMAIL PROTECTED] To: [EMAIL PROTECTED] In-Reply-To: <p04310103b4eae66b4370@[171.66.196.146]> Date: Fri, 10 Nov 2000 22:47:29 -0800 Content-transfer-encoding: 7bit
<x-flowed> I have a consulting customer writing a search engine looking for a heavy-duty robot spider that can handle millions of URLs. This one would have to be very robust, have a decent API, behave nicely, handle ugly HTML and strange links, etc. etc. Please contact me with rates if you would like to be considered. Avi PS I also get calls asking for smaller-scale spiders, so let me know if you have that code as well. -- _________________________________________________ Complete Guide to Search Engines for Web Sites, Intranets, and Portals: <http://www.searchtools.com> </x-flowed>