On one of my sites I have a script that cfhttp's a url and strips out all of the meta information, body and such and does calculations such as keyword density on them but it doesn't index an entire site. It just does one url at a time.
I don't think it's what you're looking for but you can try it out and let me know if you need the code. http://www.GlobalPromoter.com//meta_spider.cfm If you want more detailed stats you can sign up for a free account and use the "site readiness tool". When you're finished using it I can delete your account so you're not in the database if you're worried about privacy. Plus I own the site so you have my word your info won't be shared. ~Jason -----Original Message----- From: Kris Pilles [mailto:[EMAIL PROTECTED]] Sent: Monday, January 13, 2003 2:39 PM To: CF-Talk Subject: Search engine spider Does anyone know where I can find some code for a search engine spider??? Or an existing one that I can check out??? Thanks Kris Pilles Website Manager Western Suffolk BOCES 507 Deer Park Rd., Building C Phone: 631-549-4900 x 267 E-mail: [EMAIL PROTECTED] ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribe&forumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Get the mailserver that powers this list at http://www.coolfusion.com Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
