I reviewed the list of user agents, I think the ones leftover in robots.txt are good. When we deploy this, we'll have to manually modify the apache config on the web units (the charm doesn't update the apache config on disk based on the config itself, which I've modified in this MP)
ready for review I think -- https://code.launchpad.net/~andersson123/autopkgtest-cloud/+git/autopkgtest-cloud/+merge/472964 Your team Canonical's Ubuntu QA is requested to review the proposed merge of ~andersson123/autopkgtest-cloud:robots.txt into autopkgtest-cloud:master. -- Mailing list: https://launchpad.net/~canonical-ubuntu-qa Post to : [email protected] Unsubscribe : https://launchpad.net/~canonical-ubuntu-qa More help : https://help.launchpad.net/ListHelp

