Generally by thworing 404 headers would do it I would think

that tells it that the page that it is asking for does not exist



On Mon, 21 Feb 2005 11:21:42 -0600, Mark W. Breneman
<[EMAIL PROTECTED]> wrote:
> Does anyone else see CFerrors from Yahoo's spider / bot  Slurp? We monitor
> all CFerrors that are generated on our servers. It seems that Yahoo! Slurp
> is responsible for over 60% of the errors per week that are thrown by our
> production webservers. It looks like Slurp is appending almost random values
> to the query strings. id=5%E2%84%91=2 or  it may append an old URL var that
> has not been used for years like "view=archive". (This one throws a
> "CF_SQL_NUMERIC" error now.)  Does anyone know of a way I can get Slurp to
> stop hitting these pages with invalid URL vars? And still keep Slurp
> indexing the site normaly?
> 
> FYI I have a custom cf error page. After thinking about this for a little
> while I can see where my custom cf error page may not look like an error
> page to Slurp.  Any idea of what I can do to make Slurp understand it is an
> error?
> 
> Thanks
> 
> Mark W. Breneman
> -Cold Fusion Developer
> -Network Administrator
>   Vivid Media
>   [EMAIL PROTECTED]
>   www.vividmedia.com <http://www.vividmedia.com/>
>   608.270.9770
> 
> 

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Logware (www.logware.us): a new and convenient web-based time tracking 
application. Start tracking and documenting hours spent on a project or with a 
client with Logware today. Try it for free with a 15 day trial account.
http://www.houseoffusion.com/banners/view.cfm?bannerid=67

Message: http://www.houseoffusion.com/lists.cfm/link=i:4:195761
Archives: http://www.houseoffusion.com/cf_lists/threads.cfm/4
Subscription: http://www.houseoffusion.com/lists.cfm/link=s:4
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Donations & Support: http://www.houseoffusion.com/tiny.cfm/54

Reply via email to