On Fri, 9 Apr 2004, Douglas Kline wrote: > > > If there were a site-wide error-handler, would htdig have been able to > > > process its response? How would htdig's behavior at such a point be > > > determined? > > > > Htdig would receive whatever error messages the site thought fit and > > index them. Quite possibly the message would be along the lines of > > "Don't like your browser, get another." Still not very useful for > > your purposes. > > > So what is the upshot of ColdFusion's response to you about a site-wide > error-handler? Would such an error-handler not be useful for htdig? If not, > would it be useful for some other purpose?
This is dependent upon their definition of an error-hander. If they are talking about something that just spits out some different text in the response, then it will make no difference to htdig; the text will be treated as part of a normal web page and htdig will try to index it. However if by error-handler they mean something that returns one of the standard HTTP status codes that indicate an error (e.g. 404, 500), then htdig should treat the page accordingly and not try to index the text returned from the server. > user_agent the same way it interprets the value "Mozilla/4.0 (htdig 3.2.b5)". > Is that right? This still leaves open the question of why the .cfm pages work > with ht-Dig version 3.1.5 for which we haven't defined "user_agent". The code that handles this piece of the process has changed a lot between 3.1.5 and 3.2.0b5. Among other things, the manner in which the User-Agent line is constructed is somewhat different and the default HTTP protocol used for making requests has changed from 1.0 to 1.1. Since it does not appear at this point that htdig is doing anything wrong, I think the ultimate answer to your question of "why" lies with the way the site you are trying to index is implemented. It would seem that they are trying to do a number of things based on various guesses about the nature of the connecting client. Jim ------------------------------------------------------- This SF.Net email is sponsored by: IBM Linux Tutorials Free Linux tutorial presented by Daniel Robbins, President and CEO of GenToo technologies. Learn everything from fundamentals to system administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click _______________________________________________ ht://Dig general mailing list: <[EMAIL PROTECTED]> ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-general
