with no return"
>>within a class file? If so, will it execute the rest of the calling taf
>>file?
>>
>>Steve
>>
>>-Original Message-
>>From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]
>>Sent: Thursday, March 18, 2004 9:45 AM
>>T
CTED]
Sent: Thursday, March 18, 2004 9:45 AM
To: [EMAIL PROTECTED]
Subject: RE: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
I believe that "redirect" is the important phrase here. Are you
talking an actual meta redirect? or a branch. If using a meta
redirect, the robot will only fo
To: [EMAIL PROTECTED]
Subject: RE: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
I believe that "redirect" is the important phrase here. Are you
talking an actual meta redirect? or a branch. If using a meta
redirect, the robot will only follow a 301 permanent redirect,
otherwise it stops
directed to if they don't have a cookie or userid,
wouldn't that stop the spider from crawling the site?
Steve
-Original Message-
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]
Sent: Thursday, March 18, 2004 9:09 AM
To: [EMAIL PROTECTED]
Subject: Re: Witango-Talk: Login/Affil
Never tried this, but remember, robots will only craw actual a href
urls. So if you have a url that is
anywhere on the
site, it is possible for the robot to crawl. I don't see why this
would not work.
would he be able to arguments to that file like the following?
Disallow: MightNotCrawl.taf?
8, 2004 9:48 AM
To: [EMAIL PROTECTED]
Subject: Re: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
Fogelson, Steve wrote:
>Windows 2003 Web Edition IIS 6.0, R:Tango 5, Oterro 3.0
>
>I would like to suggest that visitors login to a site when they first enter
>it. Presently I check
March 18, 2004 9:09 AM
To: [EMAIL PROTECTED]
Subject: Re: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
Create a robots.txt file and add it to the top of the heiarchy of the
site. In the robots.txt file, add the following
User-agent: *
Disallow: DoNotCrawlThisPage.taf
The DoNotCrawlThisPa
would he be able to arguments to that file like the following?
Disallow: MightNotCrawl.taf?status=SuggestLogin
/John
[EMAIL PROTECTED] wrote:
Create a robots.txt file and add it to the top of the heiarchy of the
site. In the robots.txt file, add the following
User-agent: *
Disallow: DoNot
Regarding spiders, you can validate <@CGIPARAM NAME="USER_AGENT"> against
a list of acceptable bots, though this is easily spoofed.
Unless you're using https, subsequent HTTP requests will present the
cookies in clear text. (Same is true for HTTP authentication). But
since it's acceptable for
Create a robots.txt file and add it to the top of the heiarchy of the
site. In the robots.txt file, add the following
User-agent: *
Disallow: DoNotCrawlThisPage.taf
The DoNotCrawlThisPage.taf is the page you do not want robots to crawl.
Hope this helps
Fogelson, Steve wrote:
Windows 2003
Fogelson, Steve wrote:
Windows 2003 Web Edition IIS 6.0, R:Tango 5, Oterro 3.0
I would like to suggest that visitors login to a site when they first enter
it. Presently I check to see if they have a user scoped userid. If they
don't I set it to the session cookie userreference. So I was thinkin
11 matches
Mail list logo
