jenkins-bot has submitted this change and it was merged. Change subject: Disallow indexing for /api/ ......................................................................
Disallow indexing for /api/ We don't want our APIs to be indexed by search engines, so disallow the /api/ entry point in robots.txt. We do want the API docs to be indexed, so whitelist those. Bug: T109023 Change-Id: I01261d5d74d194f6fe5f46023366c9a9b5b5ff9e --- M robots.txt 1 file changed, 5 insertions(+), 0 deletions(-) Approvals: CSteipp: Looks good to me, but someone else must approve Alex Monk: Looks good to me, approved Mobrovac: Looks good to me, but someone else must approve jenkins-bot: Verified diff --git a/robots.txt b/robots.txt index 192d094..fcf8c3e 100644 --- a/robots.txt +++ b/robots.txt @@ -141,10 +141,15 @@ # These views aren't HTTP-cached but use parser cache aggressively # and don't expose special: pages etc. # +# Another exception is for REST API documentation, located at +# /api/rest_v1/?doc. +# User-agent: * Allow: /w/api.php?action=mobileview& Allow: /w/load.php? +Allow: /api/rest_v1/?doc Disallow: /w/ +Disallow: /api/ Disallow: /trap/ Disallow: /wiki/Especial:Search Disallow: /wiki/Especial%3ASearch -- To view, visit https://gerrit.wikimedia.org/r/236200 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: I01261d5d74d194f6fe5f46023366c9a9b5b5ff9e Gerrit-PatchSet: 6 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: GWicke <[email protected]> Gerrit-Reviewer: Alex Monk <[email protected]> Gerrit-Reviewer: CSteipp <[email protected]> Gerrit-Reviewer: GWicke <[email protected]> Gerrit-Reviewer: MaxSem <[email protected]> Gerrit-Reviewer: Mobrovac <[email protected]> Gerrit-Reviewer: Ori.livneh <[email protected]> Gerrit-Reviewer: jenkins-bot <> _______________________________________________ MediaWiki-commits mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
