Yes, this was just an attempt at reducing traffic and google allows
you to set a custom crawl rate.  It will be removed when we switch
servers.

Simon

On Wed, Feb 17, 2010 at 6:54 PM, Jon Stockill <[email protected]> wrote:
> John Denker wrote:
>
>> Really?  A collective, open-source project that doesn't
>> allow anybody other than google to index the documentation?
>>
>> Is there a reason for this?
>
> Presumably because there are some truly awful bots out there, and google
> at least is known to be well behaved.
>
> Jon
>
>
> ------------------------------------------------------------------------------
> Download Intel&reg; Parallel Studio Eval
> Try the new software tools for yourself. Speed compiling, find bugs
> proactively, and fine-tune applications for parallel performance.
> See why Intel Parallel Studio got high marks during beta.
> http://p.sf.net/sfu/intel-sw-dev
> _______________________________________________
> Flightgear-devel mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/flightgear-devel
>

------------------------------------------------------------------------------
Download Intel&reg; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs 
proactively, and fine-tune applications for parallel performance. 
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Flightgear-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/flightgear-devel

Reply via email to