Christopher Adams wrote: > > 3) added a robots.txt file to specifically block that >domain
You are probably aware of this, but for those who may not be, legitimate search engines and such will honor your robots.txt file directives and meta tag (no)index,(no)follow directives in pages, but spammers and the like crawling your site for nefarious purposes will ignore them. -- Mark Sapiro <m...@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan ------------------------------------------------------ Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
