--- On Thu 06/23, Ron Ferguson < [EMAIL PROTECTED] > wrote:

> The crawler does not go through to your web page as a visitor would but
> reads directly the html code such as your meta, h1, title, alt and other
> html tags. thus it does not need to access via a password. 


The web crawler issues a GET request just as your browser does.  If your 
directory is password protected with an .htaccess file, the web crawler
is not going to be able to index it... unless it can supply the correct
credentials...


Steve


_______________________________________________
No banners. No pop-ups. No kidding.
Make My Way  your home on the Web - http://www.myway.com


Legacy User Group Etiquette guidelines can be found at:
http://www.LegacyFamilyTree.com/Etiquette.asp

To find past messages, please go to our searchable archives at:
http://www.mail-archive.com/legacyusergroup%40mail.millenniacorp.com/

To unsubscribe please visit:
http://www.legacyfamilytree.com/LegacyLists.asp

Reply via email to