

you’ll see that “slop” in the survey does not refer to AI-driven PRs in general, but to specifically low-quality AI-generated PRs.
This part is actually unclear. The question posed to survey participants that allowed researchers to determine a PR was “AI slop” is left out of the report. And this line under the chart showing “25% slop etc.” is troubling:
Average estimated percentage of incoming PRs that are low-quality and/or AI-generated
How this particular question was framed is of critical importance here and without it, it’s easy to assume that all reported AI use was broadly categorized as “slop”
Sadly I could not find a way to access the full list of questions used in the survey to confirm this.

Can’t thank you enough for this list!!! I asked anti AI folks and the best I got was a study on AI assisted essay writing with 8 people per control group. The rest were insults, mockery, shifting goalposts, so naturally, as someone who just arrived at the fence, I found myself siding with the less troll-ey side. My guess is this is more an issue of “worse than an enemy is an incompetent ally” because any single study in your list would have done it for me.
This study has some positives on AI use in coding, but I’d exercise caution due to the tabloid-ey nature of using the term “AI-slop” everywhere in a study that’s supposed to be unbiased.