On Sat, Oct 17, 2015 at 04:46:00PM +0200, Jean-Marc Lasgouttes wrote: > Le 17/10/15 10:38, Liviu Andronic a écrit : > >On Sat, Oct 17, 2015 at 12:52 AM, Scott Kostyshak <skost...@lyx.org> wrote: > >>I was trying to view a trac ticket and because our server is down I > >>wanted to find it on google and view the cache. > >> > >If it can be of any consolation, Xfce does the same thing: > >http://xfce.10915.n7.nabble.com/https-bugzilla-xfce-org-robots-txt-td45275.html#a45285 > > > >https://bugzilla.xfce.org/show_bug.cgi?id=11404 > > > >Apparently it's an issue of server capacity given that search engines > >tend to send a lot of requests. Given our somewhat frequent server > >downtimes, it's probably wise to keep robots off the site. Some > >suggest however that the rate of search engine overload can be > >controlled (see above links). > > Yes, now I remember that we did that at some time to keep our server happy.
Ah makes sense. Thanks for the explanation, Liviu. Scott
