Dear all,
Have any of you encountered an extensive crawling by Bytespider and
Bytedance (see e.g.,
https://wordpress.org/support/topic/psa-bytedance-and-bytespider-bots-recommend-blocking/),
Claudebot or other AI bots?
If so, do you have any secret recipe how to disable the crawler from
accessing the site?
Thank you very much for sharing your experience!
Linda
_______________________________________________
Evergreen-general mailing list
Evergreen-general@list.evergreen-ils.org
http://list.evergreen-ils.org/cgi-bin/mailman/listinfo/evergreen-general
