Type: url
Original: https://arxiv.org/abs/2603.00539
Status: generated
Language: en
Summary
This 2026 paper finds that LLMs used as code reviewers systematically misjudge correct code as failing its natural-language requirements, and that more detailed prompts asking for explanations and proposed fixes raise this misjudgment rate. The authors analyse the mechanisms behind these failures and propose a Fix-guided Verification Filter that treats the model’s proposed fix as executable counterfactual evidence, testing both original and revised code against benchmark and spec-constrained augmented tests.