Re: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
Fogelson, Steve wrote: Windows 2003 Web Edition IIS 6.0, R:Tango 5, Oterro 3.0 I would like to suggest that visitors login to a site when they first enter it. Presently I check to see if they have a user scoped userid. If they don't I set it to the session cookie userreference. So I was thinking that if they didn't have a user id, I would redirect to a page that would list benefits of signing in and provide login input fields. I also want to create a persistent cookie to place on their computer that would contain an affiliate code if the visitor was referred to the site by an affiliate. So I could check to see if they have this cookie first. If they have a cookie, it would be nice to log them in as well as read their affiliate code. But I don't know how to transmit encrypted account and password info in the form of a cookie first to their computer and then at a later date (subsequent visits) back to my site. Any comments? I also have a challenge when a search engine spider hits the site. I don't want to redirect the spider to a "login suggestion" page. Any suggestions on how to determine if the visitor is a spider? Maybe use <@CGIPARAM>. I noticed when looking at my IIS logs, that there are entries like the following: Why do you care if the spider indexes your login suggestion page. Assuming that page still has links to the content that you want to be indexed by the spider, I don't see any harm in it indexing that suggestion page. And if you didn't want it to index that page, there might even be an http heaeder or tag that you could add to just that login suggestion page that would cause the bot to not index it. To answer your question below, you can get to that data through the @CGIPARAM tag. It's the "USER_AGENT" /John 66.196.93.29 HTTP/1.0 YahooSeeker/1.1+(compatible;+Mozilla+4.0;+MSIE+5.5;+http://help.yahoo.com/he lp/us/shop/merchant/) 64.68.82.55 HTTP/1.0 Googlebot/2.1+(+http://www.googlebot.com/bot.html) 66.196.65.40 HTTP/1.0 Mozilla/5.0+(compatible;+Yahoo!+Slurp;+http://help.yahoo.com/help/us/ysearch /slurp) Is this accessible by Witango? Is it consistent? Is it useful? Thanks for any ideas. Steve Fogelson Internet Commerce Solutions TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf
Re: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
Create a robots.txt file and add it to the top of the heiarchy of the site. In the robots.txt file, add the following User-agent: * Disallow: DoNotCrawlThisPage.taf The DoNotCrawlThisPage.taf is the page you do not want robots to crawl. Hope this helps Fogelson, Steve wrote: Windows 2003 Web Edition IIS 6.0, R:Tango 5, Oterro 3.0 I would like to suggest that visitors login to a site when they first enter it. Presently I check to see if they have a user scoped userid. If they don't I set it to the session cookie userreference. So I was thinking that if they didn't have a user id, I would redirect to a page that would list benefits of signing in and provide login input fields. I also want to create a persistent cookie to place on their computer that would contain an affiliate code if the visitor was referred to the site by an affiliate. So I could check to see if they have this cookie first. If they have a cookie, it would be nice to log them in as well as read their affiliate code. But I don't know how to transmit encrypted account and password info in the form of a cookie first to their computer and then at a later date (subsequent visits) back to my site. Any comments? I also have a challenge when a search engine spider hits the site. I don't want to redirect the spider to a "login suggestion" page. Any suggestions on how to determine if the visitor is a spider? Maybe use <@CGIPARAM>. I noticed when looking at my IIS logs, that there are entries like the following: Why do you care if the spider indexes your login suggestion page. Assuming that page still has links to the content that you want to be indexed by the spider, I don't see any harm in it indexing that suggestion page. And if you didn't want it to index that page, there might even be an http heaeder or tag that you could add to just that login suggestion page that would cause the bot to not index it. To answer your question below, you can get to that data through the @CGIPARAM tag. It's the "USER_AGENT" /John 66.196.93.29 HTTP/1.0 YahooSeeker/1.1+(compatible;+Mozilla+4.0;+MSIE+5.5;+http://help.yahoo.com/he lp/us/shop/merchant/) 64.68.82.55 HTTP/1.0 Googlebot/2.1+(+http://www.googlebot.com/bot.html) 66.196.65.40 HTTP/1.0 Mozilla/5.0+(compatible;+Yahoo!+Slurp;+http://help.yahoo.com/help/us/ysearch /slurp) Is this accessible by Witango? Is it consistent? Is it useful? Thanks for any ideas. Steve Fogelson Internet Commerce Solutions TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf -- TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf
Re: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
Regarding spiders, you can validate <@CGIPARAM NAME="USER_AGENT"> against a list of acceptable bots, though this is easily spoofed. Unless you're using https, subsequent HTTP requests will present the cookies in clear text. (Same is true for HTTP authentication). But since it's acceptable for anonymous anauthenticated users (google, for example) to browse the site, why worry about encrypting anything? And since the spiders will provide deep linking, so users might be taken to a dynamic page well past the home page, the logic to redirect to login benefits needs to be in every appfile. >Windows 2003 Web Edition IIS 6.0, R:Tango 5, Oterro 3.0 > >I would like to suggest that visitors login to a site when they first enter >it. Presently I check to see if they have a user scoped userid. If they >don't I set it to the session cookie userreference. So I was thinking that >if they didn't have a user id, I would redirect to a page that would list >benefits of signing in and provide login input fields. > >I also want to create a persistent cookie to place on their computer that >would contain an affiliate code if the visitor was referred to the site by >an affiliate. So I could check to see if they have this cookie first. If >they have a cookie, it would be nice to log them in as well as read their >affiliate code. But I don't know how to transmit encrypted account and >password info in the form of a cookie first to their computer and then at a >later date (subsequent visits) back to my site. Any comments? > >I also have a challenge when a search engine spider hits the site. I don't >want to redirect the spider to a "login suggestion" page. Any suggestions on >how to determine if the visitor is a spider? Maybe use <@CGIPARAM>. I >noticed when looking at my IIS logs, that there are entries like the >following: > >66.196.93.29 HTTP/1.0 >YahooSeeker/1.1+(compatible;+Mozilla+4.0;+MSIE+5.5;+http://help.yahoo.com/he >lp/us/shop/merchant/) >64.68.82.55 HTTP/1.0 Googlebot/2.1+(+http://www.googlebot.com/bot.html) >66.196.65.40 HTTP/1.0 >Mozilla/5.0+(compatible;+Yahoo!+Slurp;+http://help.yahoo.com/help/us/ysearch >/slurp) > >Is this accessible by Witango? Is it consistent? Is it useful? > >Thanks for any ideas. > >Steve Fogelson >Internet Commerce Solutions > >TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf > Bill Conlon To the Point 345 California Avenue Suite 2 Palo Alto, CA 94306 office: 650.327.2175 fax:650.329.8335 mobile: 650.906.9929 e-mail: mailto:[EMAIL PROTECTED] web:http://www.tothept.com TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf
Re: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
would he be able to arguments to that file like the following? Disallow: MightNotCrawl.taf?status=SuggestLogin /John [EMAIL PROTECTED] wrote: Create a robots.txt file and add it to the top of the heiarchy of the site. In the robots.txt file, add the following User-agent: * Disallow: DoNotCrawlThisPage.taf The DoNotCrawlThisPage.taf is the page you do not want robots to crawl. Hope this helps Fogelson, Steve wrote: Windows 2003 Web Edition IIS 6.0, R:Tango 5, Oterro 3.0 I would like to suggest that visitors login to a site when they first enter it. Presently I check to see if they have a user scoped userid. If they don't I set it to the session cookie userreference. So I was thinking that if they didn't have a user id, I would redirect to a page that would list benefits of signing in and provide login input fields. I also want to create a persistent cookie to place on their computer that would contain an affiliate code if the visitor was referred to the site by an affiliate. So I could check to see if they have this cookie first. If they have a cookie, it would be nice to log them in as well as read their affiliate code. But I don't know how to transmit encrypted account and password info in the form of a cookie first to their computer and then at a later date (subsequent visits) back to my site. Any comments? I also have a challenge when a search engine spider hits the site. I don't want to redirect the spider to a "login suggestion" page. Any suggestions on how to determine if the visitor is a spider? Maybe use <@CGIPARAM>. I noticed when looking at my IIS logs, that there are entries like the following: Why do you care if the spider indexes your login suggestion page. Assuming that page still has links to the content that you want to be indexed by the spider, I don't see any harm in it indexing that suggestion page. And if you didn't want it to index that page, there might even be an http heaeder or tag that you could add to just that login suggestion page that would cause the bot to not index it. To answer your question below, you can get to that data through the @CGIPARAM tag. It's the "USER_AGENT" /John 66.196.93.29 HTTP/1.0 YahooSeeker/1.1+(compatible;+Mozilla+4.0;+MSIE+5.5;+http://help.yahoo.com/he lp/us/shop/merchant/) 64.68.82.55 HTTP/1.0 Googlebot/2.1+(+http://www.googlebot.com/bot.html) 66.196.65.40 HTTP/1.0 Mozilla/5.0+(compatible;+Yahoo!+Slurp;+http://help.yahoo.com/help/us/ysearch /slurp) Is this accessible by Witango? Is it consistent? Is it useful? Thanks for any ideas. Steve Fogelson Internet Commerce Solutions TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf
RE: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
I have a routine that every page in my site executes, so implementation should be pretty easy. So every time a visitor selects a page, I check for a userid. If not present I would check for a cookie. If neither, I would redirect to the "login benefits" page. If I don't allow spiders to crawl this page (with robots.txt) and this is the page the visitor is redirected to if they don't have a cookie or userid, wouldn't that stop the spider from crawling the site? Steve -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Sent: Thursday, March 18, 2004 9:09 AM To: [EMAIL PROTECTED] Subject: Re: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT) Create a robots.txt file and add it to the top of the heiarchy of the site. In the robots.txt file, add the following User-agent: * Disallow: DoNotCrawlThisPage.taf The DoNotCrawlThisPage.taf is the page you do not want robots to crawl. Hope this helps >Fogelson, Steve wrote: > >>Windows 2003 Web Edition IIS 6.0, R:Tango 5, Oterro 3.0 >> >>I would like to suggest that visitors login to a site when they first enter >>it. Presently I check to see if they have a user scoped userid. If they >>don't I set it to the session cookie userreference. So I was thinking that >>if they didn't have a user id, I would redirect to a page that would list >>benefits of signing in and provide login input fields. >>I also want to create a persistent cookie to place on their computer that >>would contain an affiliate code if the visitor was referred to the site by >>an affiliate. So I could check to see if they have this cookie first. If >>they have a cookie, it would be nice to log them in as well as read their >>affiliate code. But I don't know how to transmit encrypted account and >>password info in the form of a cookie first to their computer and then at a >>later date (subsequent visits) back to my site. Any comments? >> >>I also have a challenge when a search engine spider hits the site. I don't >>want to redirect the spider to a "login suggestion" page. Any suggestions on >>how to determine if the visitor is a spider? Maybe use <@CGIPARAM>. I >>noticed when looking at my IIS logs, that there are entries like the >>following: >> >Why do you care if the spider indexes your login suggestion page. >Assuming that page still has links to the content that you want to >be indexed by the spider, I don't see any harm in it indexing that >suggestion page. And if you didn't want it to index that page, >there might even be an http heaeder or tag that you could add >to just that login suggestion page that would cause the bot to not >index it. > >To answer your question below, you can get to that data through the >@CGIPARAM tag. It's the "USER_AGENT" > >/John > >>66.196.93.29 HTTP/1.0 >>YahooSeeker/1.1+(compatible;+Mozilla+4.0;+MSIE+5.5;+http://help.yahoo.com/ he >>lp/us/shop/merchant/) >>64.68.82.55 HTTP/1.0 Googlebot/2.1+(+http://www.googlebot.com/bot.html) >>66.196.65.40 HTTP/1.0 >>Mozilla/5.0+(compatible;+Yahoo!+Slurp;+http://help.yahoo.com/help/us/ysear ch >>/slurp) >> >>Is this accessible by Witango? Is it consistent? Is it useful? >> >>Thanks for any ideas. >>Steve Fogelson >>Internet Commerce Solutions >> >>TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf >> >> > > >TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf -- TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf
RE: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
John, The more I think about it, I think you are right. The "Login Benefits" page would have all the standard links, so maybe it doesn't matter if they crawl this page. Thanks Steve -Original Message- From: John McGowan [mailto:[EMAIL PROTECTED] Sent: Thursday, March 18, 2004 9:48 AM To: [EMAIL PROTECTED] Subject: Re: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT) Fogelson, Steve wrote: >Windows 2003 Web Edition IIS 6.0, R:Tango 5, Oterro 3.0 > >I would like to suggest that visitors login to a site when they first enter >it. Presently I check to see if they have a user scoped userid. If they >don't I set it to the session cookie userreference. So I was thinking that >if they didn't have a user id, I would redirect to a page that would list >benefits of signing in and provide login input fields. > >I also want to create a persistent cookie to place on their computer that >would contain an affiliate code if the visitor was referred to the site by >an affiliate. So I could check to see if they have this cookie first. If >they have a cookie, it would be nice to log them in as well as read their >affiliate code. But I don't know how to transmit encrypted account and >password info in the form of a cookie first to their computer and then at a >later date (subsequent visits) back to my site. Any comments? > >I also have a challenge when a search engine spider hits the site. I don't >want to redirect the spider to a "login suggestion" page. Any suggestions on >how to determine if the visitor is a spider? Maybe use <@CGIPARAM>. I >noticed when looking at my IIS logs, that there are entries like the >following: > > Why do you care if the spider indexes your login suggestion page. Assuming that page still has links to the content that you want to be indexed by the spider, I don't see any harm in it indexing that suggestion page. And if you didn't want it to index that page, there might even be an http heaeder or tag that you could add to just that login suggestion page that would cause the bot to not index it. To answer your question below, you can get to that data through the @CGIPARAM tag. It's the "USER_AGENT" /John >66.196.93.29 HTTP/1.0 >YahooSeeker/1.1+(compatible;+Mozilla+4.0;+MSIE+5.5;+http://help.yahoo.com/h e >lp/us/shop/merchant/) >64.68.82.55 HTTP/1.0 Googlebot/2.1+(+http://www.googlebot.com/bot.html) >66.196.65.40 HTTP/1.0 >Mozilla/5.0+(compatible;+Yahoo!+Slurp;+http://help.yahoo.com/help/us/ysearc h >/slurp) > >Is this accessible by Witango? Is it consistent? Is it useful? > >Thanks for any ideas. > >Steve Fogelson >Internet Commerce Solutions > >TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf > > > TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf
Re: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
Never tried this, but remember, robots will only craw actual a href urls. So if you have a url that is anywhere on the site, it is possible for the robot to crawl. I don't see why this would not work. would he be able to arguments to that file like the following? Disallow: MightNotCrawl.taf?status=SuggestLogin /John [EMAIL PROTECTED] wrote: Create a robots.txt file and add it to the top of the heiarchy of the site. In the robots.txt file, add the following User-agent: * Disallow: DoNotCrawlThisPage.taf The DoNotCrawlThisPage.taf is the page you do not want robots to crawl. Hope this helps Fogelson, Steve wrote: Windows 2003 Web Edition IIS 6.0, R:Tango 5, Oterro 3.0 I would like to suggest that visitors login to a site when they first enter it. Presently I check to see if they have a user scoped userid. If they don't I set it to the session cookie userreference. So I was thinking that if they didn't have a user id, I would redirect to a page that would list benefits of signing in and provide login input fields. I also want to create a persistent cookie to place on their computer that would contain an affiliate code if the visitor was referred to the site by an affiliate. So I could check to see if they have this cookie first. If they have a cookie, it would be nice to log them in as well as read their affiliate code. But I don't know how to transmit encrypted account and password info in the form of a cookie first to their computer and then at a later date (subsequent visits) back to my site. Any comments? I also have a challenge when a search engine spider hits the site. I don't want to redirect the spider to a "login suggestion" page. Any suggestions on how to determine if the visitor is a spider? Maybe use <@CGIPARAM>. I noticed when looking at my IIS logs, that there are entries like the following: Why do you care if the spider indexes your login suggestion page. Assuming that page still has links to the content that you want to be indexed by the spider, I don't see any harm in it indexing that suggestion page. And if you didn't want it to index that page, there might even be an http heaeder or tag that you could add to just that login suggestion page that would cause the bot to not index it. To answer your question below, you can get to that data through the @CGIPARAM tag. It's the "USER_AGENT" /John 66.196.93.29 HTTP/1.0 YahooSeeker/1.1+(compatible;+Mozilla+4.0;+MSIE+5.5;+http://help.yahoo.com/he lp/us/shop/merchant/) 64.68.82.55 HTTP/1.0 Googlebot/2.1+(+http://www.googlebot.com/bot.html) 66.196.65.40 HTTP/1.0 Mozilla/5.0+(compatible;+Yahoo!+Slurp;+http://help.yahoo.com/help/us/ysearch /slurp) Is this accessible by Witango? Is it consistent? Is it useful? Thanks for any ideas. Steve Fogelson Internet Commerce Solutions TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf -- TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf
RE: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
I believe that "redirect" is the important phrase here. Are you talking an actual meta redirect? or a branch. If using a meta redirect, the robot will only follow a 301 permanent redirect, otherwise it stops. I have a routine that every page in my site executes, so implementation should be pretty easy. So every time a visitor selects a page, I check for a userid. If not present I would check for a cookie. If neither, I would redirect to the "login benefits" page. If I don't allow spiders to crawl this page (with robots.txt) and this is the page the visitor is redirected to if they don't have a cookie or userid, wouldn't that stop the spider from crawling the site? Steve -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Sent: Thursday, March 18, 2004 9:09 AM To: [EMAIL PROTECTED] Subject: Re: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT) Create a robots.txt file and add it to the top of the heiarchy of the site. In the robots.txt file, add the following User-agent: * Disallow: DoNotCrawlThisPage.taf The DoNotCrawlThisPage.taf is the page you do not want robots to crawl. Hope this helps Fogelson, Steve wrote: Windows 2003 Web Edition IIS 6.0, R:Tango 5, Oterro 3.0 I would like to suggest that visitors login to a site when they first enter it. Presently I check to see if they have a user scoped userid. If they don't I set it to the session cookie userreference. So I was thinking that if they didn't have a user id, I would redirect to a page that would list benefits of signing in and provide login input fields. I also want to create a persistent cookie to place on their computer that would contain an affiliate code if the visitor was referred to the site by an affiliate. So I could check to see if they have this cookie first. If they have a cookie, it would be nice to log them in as well as read their affiliate code. But I don't know how to transmit encrypted account and password info in the form of a cookie first to their computer and then at a later date (subsequent visits) back to my site. Any comments? I also have a challenge when a search engine spider hits the site. I don't want to redirect the spider to a "login suggestion" page. Any suggestions on how to determine if the visitor is a spider? Maybe use <@CGIPARAM>. I noticed when looking at my IIS logs, that there are entries like the following: Why do you care if the spider indexes your login suggestion page. Assuming that page still has links to the content that you want to be indexed by the spider, I don't see any harm in it indexing that suggestion page. And if you didn't want it to index that page, there might even be an http heaeder or tag that you could add to just that login suggestion page that would cause the bot to not index it. To answer your question below, you can get to that data through the @CGIPARAM tag. It's the "USER_AGENT" /John 66.196.93.29 HTTP/1.0 YahooSeeker/1.1+(compatible;+Mozilla+4.0;+MSIE+5.5;+http://help.yahoo.com/ he lp/us/shop/merchant/) 64.68.82.55 HTTP/1.0 Googlebot/2.1+(+http://www.googlebot.com/bot.html) 66.196.65.40 HTTP/1.0 Mozilla/5.0+(compatible;+Yahoo!+Slurp;+http://help.yahoo.com/help/us/ysear ch /slurp) Is this accessible by Witango? Is it consistent? Is it useful? Thanks for any ideas. Steve Fogelson Internet Commerce Solutions TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf -- TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf -- TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf
RE: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
Great point. I should probably use a branch. Can you "branch with no return" within a class file? If so, will it execute the rest of the calling taf file? Steve -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Sent: Thursday, March 18, 2004 9:45 AM To: [EMAIL PROTECTED] Subject: RE: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT) I believe that "redirect" is the important phrase here. Are you talking an actual meta redirect? or a branch. If using a meta redirect, the robot will only follow a 301 permanent redirect, otherwise it stops. >I have a routine that every page in my site executes, so implementation >should be pretty easy. > >So every time a visitor selects a page, I check for a userid. If not present >I would check for a cookie. If neither, I would redirect to the "login >benefits" page. > >If I don't allow spiders to crawl this page (with robots.txt) and this is >the page the visitor is redirected to if they don't have a cookie or userid, >wouldn't that stop the spider from crawling the site? > >Steve > >-Original Message- >From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] >Sent: Thursday, March 18, 2004 9:09 AM >To: [EMAIL PROTECTED] >Subject: Re: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT) > > >Create a robots.txt file and add it to the top of the heiarchy of the >site. In the robots.txt file, add the following > >User-agent: * >Disallow: DoNotCrawlThisPage.taf > >The DoNotCrawlThisPage.taf is the page you do not want robots to crawl. > >Hope this helps > > > >>Fogelson, Steve wrote: >> >>>Windows 2003 Web Edition IIS 6.0, R:Tango 5, Oterro 3.0 >>> >>>I would like to suggest that visitors login to a site when they first >enter >>>it. Presently I check to see if they have a user scoped userid. If they >>>don't I set it to the session cookie userreference. So I was thinking that >>>if they didn't have a user id, I would redirect to a page that would list >>>benefits of signing in and provide login input fields. >>>I also want to create a persistent cookie to place on their computer that >>>would contain an affiliate code if the visitor was referred to the site by >>>an affiliate. So I could check to see if they have this cookie first. If >>>they have a cookie, it would be nice to log them in as well as read their >>>affiliate code. But I don't know how to transmit encrypted account and >>>password info in the form of a cookie first to their computer and then at >a >>>later date (subsequent visits) back to my site. Any comments? >>> >>>I also have a challenge when a search engine spider hits the site. I don't >>>want to redirect the spider to a "login suggestion" page. Any suggestions >on >>>how to determine if the visitor is a spider? Maybe use <@CGIPARAM>. I >>>noticed when looking at my IIS logs, that there are entries like the >>>following: >>> >>Why do you care if the spider indexes your login suggestion page. >>Assuming that page still has links to the content that you want to >>be indexed by the spider, I don't see any harm in it indexing that >>suggestion page. And if you didn't want it to index that page, >>there might even be an http heaeder or tag that you could add >>to just that login suggestion page that would cause the bot to not >>index it. >> >>To answer your question below, you can get to that data through the >>@CGIPARAM tag. It's the "USER_AGENT" >> >>/John >> >>>66.196.93.29 HTTP/1.0 >>>YahooSeeker/1.1+(compatible;+Mozilla+4.0;+MSIE+5.5;+http://help.yahoo.com / >he >>>lp/us/shop/merchant/) >>>64.68.82.55 HTTP/1.0 Googlebot/2.1+(+http://www.googlebot.com/bot.html) >>>66.196.65.40 HTTP/1.0 >>>Mozilla/5.0+(compatible;+Yahoo!+Slurp;+http://help.yahoo.com/help/us/ysea r >ch >>>/slurp) >>> >>>Is this accessible by Witango? Is it consistent? Is it useful? >>> >>>Thanks for any ideas. >>>Steve Fogelson >>>Internet Commerce Solutions >>> >>>TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf >>> >>> >> >> >>TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf > > >-- > >TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf > >TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf -- TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf
RE: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
Not sure. Somebody else will have to answer this. Great point. I should probably use a branch. Can you "branch with no return" within a class file? If so, will it execute the rest of the calling taf file? Steve -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Sent: Thursday, March 18, 2004 9:45 AM To: [EMAIL PROTECTED] Subject: RE: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT) I believe that "redirect" is the important phrase here. Are you talking an actual meta redirect? or a branch. If using a meta redirect, the robot will only follow a 301 permanent redirect, otherwise it stops. I have a routine that every page in my site executes, so implementation should be pretty easy. So every time a visitor selects a page, I check for a userid. If not present I would check for a cookie. If neither, I would redirect to the "login benefits" page. If I don't allow spiders to crawl this page (with robots.txt) and this is the page the visitor is redirected to if they don't have a cookie or userid, wouldn't that stop the spider from crawling the site? Steve -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Sent: Thursday, March 18, 2004 9:09 AM To: [EMAIL PROTECTED] Subject: Re: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT) Create a robots.txt file and add it to the top of the heiarchy of the site. In the robots.txt file, add the following User-agent: * Disallow: DoNotCrawlThisPage.taf The DoNotCrawlThisPage.taf is the page you do not want robots to crawl. Hope this helps Fogelson, Steve wrote: Windows 2003 Web Edition IIS 6.0, R:Tango 5, Oterro 3.0 I would like to suggest that visitors login to a site when they first enter it. Presently I check to see if they have a user scoped userid. If they don't I set it to the session cookie userreference. So I was thinking that if they didn't have a user id, I would redirect to a page that would list benefits of signing in and provide login input fields. I also want to create a persistent cookie to place on their computer that would contain an affiliate code if the visitor was referred to the site by an affiliate. So I could check to see if they have this cookie first. If they have a cookie, it would be nice to log them in as well as read their affiliate code. But I don't know how to transmit encrypted account and password info in the form of a cookie first to their computer and then at a later date (subsequent visits) back to my site. Any comments? I also have a challenge when a search engine spider hits the site. I don't want to redirect the spider to a "login suggestion" page. Any suggestions on how to determine if the visitor is a spider? Maybe use <@CGIPARAM>. I noticed when looking at my IIS logs, that there are entries like the following: Why do you care if the spider indexes your login suggestion page. Assuming that page still has links to the content that you want to be indexed by the spider, I don't see any harm in it indexing that suggestion page. And if you didn't want it to index that page, there might even be an http heaeder or tag that you could add to just that login suggestion page that would cause the bot to not index it. To answer your question below, you can get to that data through the @CGIPARAM tag. It's the "USER_AGENT" /John 66.196.93.29 HTTP/1.0 YahooSeeker/1.1+(compatible;+Mozilla+4.0;+MSIE+5.5;+http://help.yahoo.com / he lp/us/shop/merchant/) 64.68.82.55 HTTP/1.0 Googlebot/2.1+(+http://www.googlebot.com/bot.html) 66.196.65.40 HTTP/1.0 Mozilla/5.0+(compatible;+Yahoo!+Slurp;+http://help.yahoo.com/help/us/ysea r ch /slurp) Is this accessible by Witango? Is it consistent? Is it useful? Thanks for any ideas. >>>Steve Fogelson Internet Commerce Solutions TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf -- TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf -- TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf -- TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf
RE: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
I prefer the HTTP header 302 redirect instead of the . I'm not aware of any bot problems with the 302. (But I haven't really looked too hard either). >Not sure. Somebody else will have to answer this. > >>Great point. I should probably use a branch. Can you "branch with no return" >>within a class file? If so, will it execute the rest of the calling taf >>file? >> >>Steve >> >>-Original Message- >>From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] >>Sent: Thursday, March 18, 2004 9:45 AM >>To: [EMAIL PROTECTED] >>Subject: RE: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT) >> >> >>I believe that "redirect" is the important phrase here. Are you >>talking an actual meta redirect? or a branch. If using a meta >>redirect, the robot will only follow a 301 permanent redirect, >>otherwise it stops. >> >>>I have a routine that every page in my site executes, so implementation >>>should be pretty easy. >>> >>>So every time a visitor selects a page, I check for a userid. If not >>present >>>I would check for a cookie. If neither, I would redirect to the "login >>>benefits" page. >>> >>>If I don't allow spiders to crawl this page (with robots.txt) and this is >>>the page the visitor is redirected to if they don't have a cookie or >>userid, >>>wouldn't that stop the spider from crawling the site? >>> >>>Steve >>> >>>-Original Message- >>>From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] >>>Sent: Thursday, March 18, 2004 9:09 AM >>>To: [EMAIL PROTECTED] >>>Subject: Re: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT) >>> >>> >>>Create a robots.txt file and add it to the top of the heiarchy of the >>>site. In the robots.txt file, add the following >>> >>>User-agent: * >>>Disallow: DoNotCrawlThisPage.taf >>> >>>The DoNotCrawlThisPage.taf is the page you do not want robots to crawl. >>> >>>Hope this helps >>> >>> >>> >>>>Fogelson, Steve wrote: >>>> >>>>>Windows 2003 Web Edition IIS 6.0, R:Tango 5, Oterro 3.0 >>>>> >>>>>I would like to suggest that visitors login to a site when they first >>>enter >>>>>it. Presently I check to see if they have a user scoped userid. If they >>>>>don't I set it to the session cookie userreference. So I was thinking >>that >>>>>if they didn't have a user id, I would redirect to a page that would list >>>>>benefits of signing in and provide login input fields. >>>>>I also want to create a persistent cookie to place on their computer that >>>>>would contain an affiliate code if the visitor was referred to the site >>by >>>>>an affiliate. So I could check to see if they have this cookie first. If >>>>>they have a cookie, it would be nice to log them in as well as read their >>>>>affiliate code. But I don't know how to transmit encrypted account and >>>>>password info in the form of a cookie first to their computer and then at >>>a >>>>>later date (subsequent visits) back to my site. Any comments? >>>>> >>>>>I also have a challenge when a search engine spider hits the site. I >>don't >>>>>want to redirect the spider to a "login suggestion" page. Any suggestions >>>on >>>>>how to determine if the visitor is a spider? Maybe use <@CGIPARAM>. I >>>>>noticed when looking at my IIS logs, that there are entries like the >>>>>following: >>>>> >>>>Why do you care if the spider indexes your login suggestion page. >>>>Assuming that page still has links to the content that you want to >>>>be indexed by the spider, I don't see any harm in it indexing that >>>>suggestion page. And if you didn't want it to index that page, >>>>there might even be an http heaeder or tag that you could add >>>>to just that login suggestion page that would cause the bot to not >>>>index it. >>>> >>>>To answer your question below, you can get to that data through the >>>>@CGIPARAM tag. It's the "USER_AGENT" >>>> >>>>/John >>>> >>>>>66.196.93.29 HTTP/1.0 >>>>>Yah
