Type: url
Original: https://arxiv.org/pdf/2602.13377
Status: generated
Summary
A survey of code review benchmarks and evaluation practices spanning the Pre-LLM and LLM eras (2015-2025), based on 99 research papers — 58 from the Pre-LLM era and 41 from the LLM era — from which the authors extract datasets, evaluation metrics, data sources and target tasks. It proposes a multi-level taxonomy organizing code review research into five high-level domains and 18 fine-grained sub-tasks, and reports a shift toward end-to-end generative peer review, wider multilingual coverage, and the near-disappearance of standalone change-understanding tasks. It closes by identifying limitations of current benchmarks and proposing broader task coverage, dynamic runtime evaluation, and taxonomy-guided fine-grained assessment.