Back to browse
I submitted 316 AI-generated PRs to open source

I submitted 316 AI-generated PRs to open source

by kimjune01·May 12, 2026·6 points·2 comments

AI Analysis

●●SolidRabbit Hole

Submitted 316 AI PRs to measure how maintainers handle the flood of automated contributions.

Strengths
  • Real-world data showing 15% to 5% drop in real vulnerability rates after AI submissions surged.
  • Documents specific maintainer responses like org-wide rejections and template enforcement tactics.
  • Highlights the asymmetry between cheap AI generation and expensive human review time.
Weaknesses
  • Methodology lacks control group comparing AI PR quality to human-submitted PRs in same repos.
  • Focuses on negative maintainer reactions without exploring successful AI contribution patterns.
Category
Target Audience

Open source maintainers and AI ethics researchers studying automated contributions

Similar To

DevRel studies · AI ethics papers · GitHub archive analysis

Similar Projects

Developer Tools●●Solid

Agent Smith – open-source agent that turns issues into pull requests

It actually runs on your infrastructure and exposes the full prompt architecture (17 phases) in the repo — useful for auditing and tuning. It automates the whole loop (clone, plan, implement, test, PR) and supports multiple ticket systems and LLM providers, which is practical for teams who can't use SaaS. That said, the author admits it's best for well-scoped tickets today; large multi-file refactors are still fragile.

Ship ItSolve My Problem
hleichsenring
303mo ago