Hi Eric, On Sat, 2026-08-15 at 10:30 -0400, Eric Melville wrote: > I had a scheduled task to pull git changes once a day, and now I get back > 429s that > seemed to indicate I was hitting the server too hard. > > Is that true? Is a daily check too much? I certainly do not mind turning it > back but am > a little surprised and curious if there is something else going on.
It isn't you personally. Sourceware is seeing waves of AI scraperbot attacks through residential proxies. Which means there are millions of ip addresses hitting the server (often just fetching one or two items and then disappearing). So it is really hard to properly throttle the actual abusers. See also the lwn articles Fighting the AI scraperbot scourge https://lwn.net/Articles/1008897/ and An update on the scraper situation https://lwn.net/Articles/1080822/ and the sourceware fediverse updates: https://fosstodon.org/@sourceware So there are a couple of ways around the nginx throttler we installed, get a bugzilla account and use that through the ip you are cloning from or get a developer account and git clone through ssh, use the git protocol to clone git://sourceware.org/git/elfutils.git use the forge https://forge.sourceware.org/elfutils/elfutils-mirror or sr.ht mirror https://git.sr.ht/~sourceware/elfutils/ Hope that helps, Mark
