Hey, Great to hear that this is a solution. Thank you very much. At this point, my mirror has been running IPv6 only for a few minutes (given that their scrapers only work in legacy IP). Most of the legacy traffic in my region is spam traffic anyway. But Anubis might then become the permanent solution (I guess that scrapers will use real internet at some point in the future).
Kind regards, Arnold Dechamps On 5/11/25 11:29 PM, Johannes Löthberg wrote:
On 11/05/2025 23.14, Arnold DECHAMPS wrote:Hello everyone, I'm getting a LOT of traffic from AI scrapers (to the point that my mirror starts to become unusable). I heared about a project called Anubis. Would this work on a mirror?Hey, It should work fine actually. The funny thing about how Anubis works is that it only triggers challenges for User-Agents containing the string "Mozilla" which the AI scraper requests do because they try to pretend to be regular web browser traffic.
OpenPGP_signature.asc
Description: OpenPGP digital signature
