Type: url
Original: https://arxiv.org/abs/2407.01489
Status: generated
Summary
“Agentless: Demystifying LLM-based Software Engineering Agents” (Xia, Deng, Dunn, Zhang; arXiv:2407.01489) asks whether complex autonomous software agents are actually necessary, and answers it by building Agentless — a three-phase process of localization, repair and patch validation in which the LLM neither decides future actions nor operates complex tools. The authors report Agentless achieving the highest performance among existing open-source software agents on SWE-bench Lite (32.00%, 96 correct fixes) at a cost of $0.70, and construct SWE-bench Lite-S by excluding problems whose ground truth patch is exact or whose issue descriptions are insufficient or misleading.