On Thu, May 7, 2009 at 10:57 AM, John Hjelmstad <[email protected]> wrote: > None of which I'm aware. The RMR relay is (receiver's) > protocol://host:port/robots.txt, which doesn't even need to exist or be > served "correctly" (404/500 OK). It would be nice for this file to be > heavily cached but at least it's a one-time load.
There are a couple of potential gotchas you might want to investigate. - no-store cache control headers - 302s from https to http - 302s in general - 401s with WWW-Authenticate - 403s
