RE: Testing bot/crawler

2003-04-02 Thread Hugo Ahlenius
I have recently been doing some experimentation with HTTrack and a CF site, to mirror a site and burn on CDs. The site uses SES URL:s. Here are some problems that I have found out: * I need to use a flag, or an identifier, or specific URL to create a special session for the replication, so I can i

Re: Testing bot/crawler

2003-04-02 Thread David K
Check out the product offerings from Watchfire. http://www.watchfire.com/products/default.asp -- David - Original Message - From: "Ian Lurie" <[EMAIL PROTECTED]> To: "CF-Talk" <[EMAIL PROTECTED]> Sent: Monday, March 31, 2003 12:03 PM Subject: SOT: Testi

Re: SOT: Testing bot/crawler

2003-04-02 Thread Thomas Chiverton
On Monday 31 Mar 2003 21:03 pm, Ian Lurie wrote: > Anyone know of anything like that? We're looking at Puffin but that's a > lot of setup time to do something pretty basic... I was impressed with http://www.perl.com/pub/a/2003/01/22/mechanize.html -- Tom C "Land of the free, home of the brave..

SOT: Testing bot/crawler

2003-03-31 Thread Ian Lurie
I'm sure this has been asked before but I can't seem to find an answer. I need a tool that'll crawl every link in a site, setting off any ColdFusion errors that might occur in the normal course of browsing. Basically, the tool should simulate a user clicking every link - if an error occurs I ca