Type: url
Original: https://arxiv.org/abs/2608.17177
Status: generated
License: CC-BY-4.0
Summary
An arXiv preprint from a Google team proposing Spec-Driven Test Generation: instructing an LLM-based coding agent to first reason about and explicitly document a piece of code’s pre-conditions, post-conditions and undefined behaviours, and to use that intermediate semi-formal specification as a scaffold for generating tests. Evaluated on production bugs from Google, the spec-driven agent is reported to improve bug detection rate by 9.8 percentage points and branch coverage by 2.5 percentage points against a conventional test-generation agent baseline. An LLM-as-a-Judge comparison is reported to favour its test suites over the baseline in 77.8% of cases and over human-authored tests in 56.7%.