That sounds like a maintenance nightmare. We're talking about thousands of entries over the course of a year or two. For example, news stories or event postings might run a few days or months, then drop off. Many of the records reference paid listings that can also be "un-expired" by changing an end date, so any time someone edits a record I might have to rewrite the whole robots.txt file.
----- Original Message ----- From: "Bryan Stevenson" <[EMAIL PROTECTED]> To: "CF-Talk" <cf-talk@houseoffusion.com> Sent: Thursday, February 03, 2005 12:56 PM Subject: Re: How to remove dynamic content from search engines? > .HTAccess file...or robots.txt > > Bryan Stevenson B.Comm. > VP & Director of E-Commerce Development > Electric Edge Systems Group Inc. > phone: 250.480.0642 > fax: 250.480.1264 > cell: 250.920.8830 > e-mail: [EMAIL PROTECTED] > web: www.electricedgesystems.com > ----- Original Message ----- > From: "Jim McAtee" <[EMAIL PROTECTED]> > To: "CF-Talk" <cf-talk@houseoffusion.com> > Sent: Thursday, February 03, 2005 11:26 AM > Subject: How to remove dynamic content from search engines? > > >> What are some strategies for removing references to old dynamically >> generated pages from search engine indexes? The problem I run into is >> that the CFM page will exist, it will execute, but the referenced data >> is >> often expired. >> >> A typical URL might look like: >> >> http://www.mysite.com/mypage.cfm?id=6957807 >> >> I can display an error message, and/or do a redirect using CFLOCATION, >> but >> the URL generally stays in the search engine indexes for quite some >> time. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Logware (www.logware.us): a new and convenient web-based time tracking application. Start tracking and documenting hours spent on a project or with a client with Logware today. Try it for free with a 15 day trial account. http://www.houseoffusion.com/banners/view.cfm?bannerid=67 Message: http://www.houseoffusion.com/lists.cfm/link=i:4:192962 Archives: http://www.houseoffusion.com/cf_lists/threads.cfm/4 Subscription: http://www.houseoffusion.com/lists.cfm/link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4 Donations & Support: http://www.houseoffusion.com/tiny.cfm/54
