see below... Bryan Stevenson B.Comm. VP & Director of E-Commerce Development Electric Edge Systems Group Inc. phone: 250.480.0642 fax: 250.480.1264 cell: 250.920.8830 e-mail: [EMAIL PROTECTED] web: www.electricedgesystems.com
----- Original Message ----- From: "Mark W. Breneman" <[EMAIL PROTECTED]> To: "CF-Talk" <cf-talk@houseoffusion.com> Sent: Monday, February 21, 2005 9:21 AM Subject: Sloppy - Yahoo! Slurp throwing CFerrors > Does anyone else see CFerrors from Yahoo's spider / bot Slurp? We monitor > all CFerrors that are generated on our servers. It seems that Yahoo! Slurp > is responsible for over 60% of the errors per week that are thrown by our > production webservers. It looks like Slurp is appending almost random > values > to the query strings. id=5%E2%84%91=2 OK this should be fixable by making your URLs spider friendly... www.yourdomain.com/index.cfm?varA=5 changes to www.yourdomain.com/index.cfm/varA/5 I can send ya the details on making this work or it may append an old URL var that > has not been used for years like "view=archive". (This one throws a > "CF_SQL_NUMERIC" error now.) Does anyone know of a way I can get Slurp to > stop hitting these pages with invalid URL vars? And still keep Slurp > indexing the site normaly? Yes you can use a robots.txt file to explicitly tell bots where they can and cannot go. I beleive you can also use an .HTAccess file to stop bots from indexing certain pages (or tells them the page is gone....bit fuzzy on this one). HTH Cheers > > > > FYI I have a custom cf error page. After thinking about this for a little > while I can see where my custom cf error page may not look like an error > page to Slurp. Any idea of what I can do to make Slurp understand it is > an > error? > > Thanks > > Mark W. Breneman > -Cold Fusion Developer > -Network Administrator > Vivid Media > [EMAIL PROTECTED] > www.vividmedia.com <http://www.vividmedia.com/> > 608.270.9770 > > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Logware (www.logware.us): a new and convenient web-based time tracking application. Start tracking and documenting hours spent on a project or with a client with Logware today. Try it for free with a 15 day trial account. http://www.houseoffusion.com/banners/view.cfm?bannerid=67 Message: http://www.houseoffusion.com/lists.cfm/link=i:4:195763 Archives: http://www.houseoffusion.com/cf_lists/threads.cfm/4 Subscription: http://www.houseoffusion.com/lists.cfm/link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4 Donations & Support: http://www.houseoffusion.com/tiny.cfm/54
