I do it a different way - using IP's can be a bit of a bummer since they might change but often as not the hostnames dont.
I detect spiders using the HTTP_USER_AGENT which identifies them either as say "kitty once hourly", "GoogleBot" or "Lycos" or some such - most of the decent spiders use the user_agent var to identify themselves and you can display alternate info dependent on which spider it is. For the majority of the content stuff we do we steer clear of using long and difficult query strings since some (not all) search engines dont like them - We use the Apache Directive (<Location> or .htaccess <Files>) to run our stuff through what looks like a directory but is in fact just a script. - James -------------------------- W: www.londontown.com @: [EMAIL PROTECTED] -------------------------- -----Original Message----- From: Dani [mailto:[EMAIL PROTECTED]] Sent: 30 May 2002 15:18 To: James Holden Cc: [EMAIL PROTECTED] Subject: Re: [PHP] Design Problem Importance: High Thanks very much for the advice! Was that actually the way to do it? If it is,where can I get list of the IPs, please... thanks again... Dani James Holden wrote: > Does it matter? > > The search engine doesnt know your producing dynamic content, its just > requesting a page to scan, regardless of the way your producing it. > > - James > -------------------------- > W: www.londontown.com > @: [EMAIL PROTECTED] > -------------------------- > > -----Original Message----- > From: Dani [mailto:[EMAIL PROTECTED]] > Sent: 30 May 2002 14:40 > To: [EMAIL PROTECTED] > Subject: [PHP] Design Problem > Importance: High > > Hi everyone, > > I'm new to this... > What is the best way to make Search Engine Crawler still index us > although we are using a script (PHP) to detect the IP of the crawler to > provide the keywords for a certain crawler? > > Any advise is welcome.. > Dani > > -- > PHP General Mailing List (http://www.php.net/) > To unsubscribe, visit: http://www.php.net/unsub.php > > -- > PHP General Mailing List (http://www.php.net/) > To unsubscribe, visit: http://www.php.net/unsub.php -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
