In the hour of 04:08 PM 7/24/2002 -0600, Roger Williams spoke this: >Hi workers, >Do you know of any html tag or meta-tag which will stop robots from >accessing a web page? I currently use the meta-tag "no index, no follow," >but I know that few robots actually support that. The point is to deny >harvesting or indexing of certain pages by robots on a web site. Anybody >have any solutions? > >All the best, >Roger
Roger, you can add a robots text file to your site which can hamper robots BUT if you are linked to any other sites the robots will find you. More info can be found here: http://www.robotstxt.org/wc/robots.html http://www.searchengineworld.com/robots/robots_tutorial.htm And there is also the robots text file generator here: http://www.webtoolcentral.com/webmaster/tools/robots_txt_file_generator/ Peter Kaulback ============= PCWorks Mailing List ================= Don't see your post? Check our posting guidelines & make sure you've followed proper posting procedures, http://pcworkers.com/rules.htm Contact list owner <[EMAIL PROTECTED]> Unsubscribing and other changes: http://pcworkers.com =====================================================
