Re: apache/sitemaps?

2005-10-07 Thread Shiva Shivakumar
Hi, thanks for the responses so far about a potential mod_sitemap OR using the current sitemap_gen tool. Since there are some questions about why this is relevant applicable to httpd or apache-running web masters, some thoughts on where we are coming from (apologies for the longer email): 1.

apache/sitemaps?

2005-10-03 Thread Shiva Shivakumar
Hello folks, We (@Google) launched Sitemaps to optimize how crawlers work with webservers, from a hit-or-miss approach to something more directed. Currently, webcrawlers (including ours) do not know about all pages on a webserver, or when they change. (A simple ls -lR in the ftp-world, that we