Type: url
Original: https://arxiv.org/pdf/2605.22534
Status: generated
Summary
This MSR ‘26 empirical study analyses 11,048 closed pull requests submitted by AI coding agents (Agentic-PRs) from the AIDev dataset, refined to 9,799 human-reviewed PRs, and manually inspects 717 of them to recover why they were merged or rejected. It finds that only 35.7% of rejections reflect clear agentic failures, with the rest driven by workflow constraints or lacking any observable rationale, and that 15.4% of merged PRs required explicit reviewer involvement. The authors conclude that merge and rejection outcomes alone misrepresent agent capability and call for interaction-aware evaluation.