I would even state that >80% of your server load is crap, if you don't block any ranges. Besides that you open yourself up to vulnerability checks and monitoring for domain hijacking etc.
> > Does the traffic from those cloud ranges have any significant impact on > your server performance? > > On Tue, Sep 12, 2023 at 10:33 AM Marc <m...@f1-outsourcing.eu > <mailto:m...@f1-outsourcing.eu> > wrote: > > > > Anyone having a suggestion on how to block cloud crawlers/bots? > Obviously I would like search engine bots to have access, but all the other > crap I want to lose. Only 'real users'. > > What is best practice for this? Just getting amazon, > googleusercontent, digitalocean, azure ip ranges and put them in something > like ipset or are there currently better ways of doing this? > > >
