> From what I see, robots.txt is automatically configured for the default 
> version:
> https://docs.readthedocs.io/en/stable/reference/robots.html

I read this as saying that the robots.txt published by the default
branch will be served from the top level of the domain
(https://proj.org/robots.txt) and that a robots.txt associated with
any other branch will be ignored.

If no robots.txt is provided, ReadTheDocs uses a default which allows
indexing of all non-hidden branches. PROJ does not appear to have any
branches that are hidden with RTD, so all versions >= 5.0 would be
indexed.

User-agent: *

Disallow: # Allow everything

Sitemap: https://proj.org/sitemap.xml

Dan
_______________________________________________
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev

Reply via email to