Re: [openstack-dev] [docs] sitemap automation suggestions

2017-10-16 Thread Petr Kovar
As for logging 301s, 302s and 404s and the scope, I don't think we are interested in checking EOL content for those. As we are about to approve https://review.openstack.org/#/c/507629/, we also want everybody to understand broken links found in EOL content won't be fixed, since no content updates

Re: [openstack-dev] [docs] sitemap automation suggestions

2017-10-07 Thread Jimmy McArthur
Megan put that one in at my urging. It's basically an extension of Google Analytics. It gives reports on 404s and tips on how to improve your sitemap. There is nothing to install on the server, we just have to put a little html or code snippet include into the site so that Google can verify

Re: [openstack-dev] [docs] sitemap automation suggestions

2017-10-06 Thread Jeremy Stanley
On 2017-10-05 22:51:31 -0400 (-0400), me...@openstack.org wrote: [...] > * setup of Google Webmaster tools (https://www.google.com/webmasters/) [...] I'm having a hard time figuring out from that page what exactly "Google Webmaster tools" is, and under what license it's distributed. Looks

[openstack-dev] [docs] sitemap automation suggestions

2017-10-05 Thread me...@openstack.org
Hello all! As you may be aware, sitemaps generation for docs.openstack.org is currently done via a manually triggered scrapy process. It currently also scrapes the entirety of docs.openstack.org, making processing slow. In order to improve the efficiency of this process, I would like to