Hey, Anubis requires running in a relatively modern browser. Pacman won't quite do. You could exclude the user agent I guess?
What makes you think that you get AI scrapers btw? I doubt they'd be interested in binary files (like large compressed packages). Best, ave On May 11, 2025 11:14:04 PM GMT+02:00, Arnold DECHAMPS <[email protected]> wrote: >Hello everyone, > >I'm getting a LOT of traffic from AI scrapers (to the point that my mirror >starts to become unusable). I heared about a project called Anubis. Would this >work on a mirror? > >Kind regards, > >Arnold Dechamps
