Type: url
Original: https://arxiv.org/pdf/2406.11638
Status: generated
Summary
The paper proposing MASAI (Modular Architecture for Software-engineering AI agents), from Microsoft Research India, in which a software engineering task is divided among five LLM-powered sub-agents — Test Template Generator, Issue Reproducer, Edit Localizer, Fixer and Ranker — each with its own objective and problem-solving strategy (ReAct or chain of thought), composed by passing one sub-agent’s output to another’s input. Using GPT-4o throughout, MASAI reports a 28.33% resolution rate on SWE-bench Lite (300 GitHub issues from 11 Python repositories), the highest among the methods it compares, and analyses how its design choices for localization, sampling-and-ranking of candidate patches, issue reproduction and edit representation contribute to that result.