Thanks for the further information.  It filled in a few gaps.

> > The same Web pages have been and are still being processed by ht-Dig
> > version 3.1.5 without these errors.  What is version 3.2.0b5 doing
> > differently?  
> 
> Possibly your 3.1.5 installation has user_agent: set in its config file,
> but your 3.2.b5 does not.


I couldn't find any definition of user_agent in either installation's
htdig.conf file.  Might there be come other explanation for why these cfm pages
don't cause a problem with version 3.1.5?


> If you (or htdig) see the error, then you can be pretty sure that the
> proper content of the page has _not_ been returned.  So a search won't
> find it.  You can also be pretty sure that any links from the page in
> question have _not_ been followed.
> 
> 
> What you need to do, if it is essential to you to index 
> Coldfusion-generated pages, is to put this line into your htdig.conf
>     user_agent: "Mozilla/4.0 (htdig 3.2.b5)"
> It should not affect other remote pages, unless they are doing a 
> robot-exclusion based on useragent, in which case you'll index things 
> you shouldn't, and they'll get upset with you.


I inserted that line in the version 3.2.0b5 htdig.conf file and, so far, so
good.  I think it's working.  At least my preliminary results say so.


> Sadly by doing this you are encouraging Macromedia to continue to ignore
> the HTTP spec, but quick-fixes generally win over doing it right :-(


We might pursue this with Macromedia but I've got to get this running in the 
short run.

Thanks again for your help.

Douglas


========
Douglas Kline
[EMAIL PROTECTED]




-------------------------------------------------------
This SF.Net email is sponsored by: IBM Linux Tutorials
Free Linux tutorial presented by Daniel Robbins, President and CEO of
GenToo technologies. Learn everything from fundamentals to system
administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click
_______________________________________________
ht://Dig general mailing list: <[EMAIL PROTECTED]>
ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-general

Reply via email to