Type: url
Original: https://arxiv.org/pdf/2602.10975
Status: generated
Summary
An ICLR 2026 paper introducing FeatureBench, a benchmark for evaluating LLM-powered coding agents on end-to-end, feature-level software development rather than single-PR bug fixing. Tasks are derived automatically from Python repositories by tracing unit tests along a runtime dependency graph and extracting the targeted feature while keeping other features working, yielding 200 evaluation tasks and 3825 executable environments from 24 repositories. The strongest configurations resolve only about 11-12.5% of tasks, far below their SWE-bench scores.