On Fri, Jun 15, 2001 at 12:52:02AM -0400, Mark J. Roberts wrote:
> On Fri, Jun 15, 2001 at 05:40:56PM +1200, David McNab wrote:
> > Alright alright,
> >
> > Who planted the &*$%&@ spider-repellant in Freenet?
> >
> > Namely, the [EMAIL PROTECTED] file, configured to exclude everything?
>
> It's coded into FProxy. I put it there because people were having
> problems with spiders overloading their nodes.
Now fproxy will 404 robots.txt when localhost requests it. Other hosts
are still denied. Committed to trunk, test if you like.
--
"Is our system--was it invented by scientists?"
"No. If scientists had invented it, they'd have tried it out first on hamsters."
Mark Roberts | [EMAIL PROTECTED]
_______________________________________________
Chat mailing list
[EMAIL PROTECTED]
http://lists.freenetproject.org/mailman/listinfo/chat
