arXiv preprint ·
Testuary: Agentic Test Generation with Zero-Shot Parallelism
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Agentic approaches for automated test generation can reach high-quality results, but they improve a given test suite incrementally, so a weak starting point may lead to many iterations or insufficient tests. To address this, we present Testuary, which provides the agentic phases with an improved starting point. Testuary first generates multiple test suites through independent, parallel zero-shot requests, checks and repairs them deterministically, and combines them into a single suite with a novel structural merging approach. A runtime-weighted set-cover reduction removes redundant tests without losing covered lines, branches, or killed mutants. After that, two agentic phases target the remaining gaps in coverage and mutation score. We compare Testuary with established search and LLM-based test generation approaches. The non-agentic first phase alone already significantly outperforms the current state-of-the-art. After the agentic phases, Testuary achieves on average more than 99.9% line and branch coverage as well as a mutation score of 98.6%, significantly outperforming all compared baseline approaches. Testuary needs fewer model requests and its test suites are on average smaller and faster than those of the compared agentic approach.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Software Engineering
HoldSpec: A Machine-Checked Model and Conformance Suite for the Payment Authorization Hold Lifecycle
Verifying Autoware Controller Node by Combining Model Verification and Runtime Monitoring
Specification-Based Testing of Large Language Models
PassSum: Leveraging Paths of Abstract Syntax Trees and Self-Supervision for Code Summarization
Taylor-Approximation-Based Repair of High Floating-Point Errors
Get the few papers worth your time in Software Engineering every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.