Bascially I need to create a search engine. And the the spider would be used to index links for the search engine
-----Original Message----- From: Jerry Johnson [mailto:[EMAIL PROTECTED]] Sent: Monday, January 13, 2003 3:24 PM To: CF-Talk Subject: RE: Search engine spider What do you mean by search engine spider (just to make sure we are all on the same page)? I am guessing you want to point a "spider" at a particular website, and get back all the links from that page. Then point to each linked page and get back all links from it, continuing until you run out of links? Jerry Johnson >>> [EMAIL PROTECTED] 01/13/03 03:00PM >>> Well ASP, .NET of CF would work... I need to write a search engine spider... I am just looking for a basic one to work with but in the end I need to be bale to start it off somewhere and let it go.... Indexing pages along the way in our datasource.... Eventually work on refinement so that I can send it out to look for certain keywords etc.... -----Original Message----- From: Ben Doom [mailto:[EMAIL PROTECTED]] Sent: Monday, January 13, 2003 2:54 PM To: CF-Talk Subject: RE: Search engine spider I suppose that depends on what language you want the code in, what platform, what features, etc. I know I wrote a web link mapper (built a map of all the links in a site) in Perl in a couple of hours. I also wrote a doohicky that would scan a site for given text mining /n/ layers deep etc. and it didn't take too much longer, as I recall. Of course, I don't have the code for either anymore. :-) Can you be more specific about what you're trying to do? Maybe someone will be able to help out a bit more. -- Ben Doom Programmer & General Lackey Moonbow Software, Inc : -----Original Message----- : From: Kris Pilles [mailto:[EMAIL PROTECTED]] : Sent: Monday, January 13, 2003 2:39 PM : To: CF-Talk : Subject: Search engine spider : : : Does anyone know where I can find some code for a search engine : spider??? Or an existing one that I can check out??? : : Thanks : : Kris Pilles : Website Manager : Western Suffolk BOCES : 507 Deer Park Rd., Building C : Phone: 631-549-4900 x 267 : E-mail: [EMAIL PROTECTED] : : : ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribe&forumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Structure your ColdFusion code with Fusebox. Get the official book at http://www.fusionauthority.com/bkinfo.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
