Wayne Sherman wrote: > Mitigation is needed, but should it block or hinder users, visitors, > and non-abusive web crawlers (legitimate search indexers and LLMs data > gathering)?
Someone with write access to the forum web server can login to Google Search Console in order to monitor and view the status of Google web crawler bot and index: https://support.google.com/webmasters/answer/9012289?hl=en https://search.google.com/search-console/about _______________________________________________ fpc-other maillist - [email protected] https://lists.freepascal.org/cgi-bin/mailman/listinfo/fpc-other
