On Tue, 2024-09-10 at 20:05 +0200, Nico Huber via coreboot wrote: > I guess that's still untested because still the robots.txt doesn't > mention gitiles? It just looks like it hasn't been updated in a > decade. It's a low hanging fruit, admins please try it!
I've added critical paths to the robots.txt on Sep 11. I can't see much difference. So most of them seem to ignore it. I'm going to work on blocking bots with some exceptions. Felix _______________________________________________ coreboot mailing list -- [email protected] To unsubscribe send an email to [email protected]
