Type: url
Original: https://arxiv.org/pdf/2408.02479
Status: generated
Summary
A survey of 139 papers, published from the latter half of 2023 to December 2024, on the application of large language models and LLM-based agents across six software engineering topics: requirement engineering and documentation, code generation and software development, autonomous learning and decision making, software design and evaluation, software test generation, and software security and maintenance. For each topic it compares the tasks, benchmarks and evaluation metrics used by plain LLM approaches against those used by LLM-based agents, and proposes six criteria for deciding when an LLM architecture qualifies as an agent. It closes with an analysis of the 82 distinct models used across the collected experiments, a comparison of benchmark and metric usage between the two paradigms, and a set of open challenges and research opportunities.