It’s amazing to me how bad these scrapers are at it, too. I’ve been battling them on my personal Forgejo instance and the amount of redundant pointless data they’re pulling is amazing. They’re also completely happy to overwhelm my server with so much traffic that they’re Three Stooges-ing themselves by essentially DDoSing the machine they want responses from.

I can only assume these scrapers are vibe coded and never critically evaluated.