vincbeck commented on PR #761: URL: https://github.com/apache/airflow-site/pull/761#issuecomment-1494979059
As far as I know it is only enable/disable. See documentation [here](https://developers.google.com/search/docs/crawling-indexing/robots/create-robots-txt). And my personal opinion is I rather not index old docs so users are always redirected to the most up to date docs and if they want to read documentation about a specific version they can select it from the left dropdown -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
