Hi, I tried to implement a bad robot trap, I mean those that do not honor the robots.txt file. Here is the robots.txt file: User-agent: * Disallow: /noBots.cfm Disallow: /bulleltin Disallow: /admin
in /noBots.cfm, for the time being I just display this: "This page was illegitimately indexed by #agFullName#." But making a search on the string "This page was illegitimately indexed" reveals that most legitimate robots have found it: Netsacpe, Google, AOL, Compuserve,... you name it. So is it really working ? IMO it is not safe to ban any robot on that only basis. Has any one a better method to submit? -- _______________________________________ REUSE CODE! Use custom tags; See http://www.contentbox.com/claude/customtags/tagstore.cfm (Please send any spam to this address: [EMAIL PROTECTED]) Thanks. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Get involved in the latest ColdFusion discussions, product development sharing, and articles on the Adobe Labs wiki. http://labs/adobe.com/wiki/index.php/ColdFusion_8 Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:292181 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
