The integration of machine learning into automated test generation: A systematic mapping study
Software Testing, Verification and Reliability · 2023-06 · 33 (4)
DOI: 10.1002/stvr.1845 ↗Kurz gefasst
Fachartikel in der Zeitschrift Software Testing, Verification and Reliability, online erschienen am 02.05.2023. Verfasst von Afonso Fontes und 1 weiteren Autor:innen. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 140 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Vetenskapsrådet.
Abstract (Originalsprache)
Machine learning (ML) may enable effective automated test generation. We characterize emerging research, examining testing practices, researcher goals, ML techniques applied, evaluation, and challenges in this intersection by performing. We perform a systematic mapping study on a sample of 124 publications. ML generates input for system, GUI, unit, performance, and combinatorial testing or improves the performance of existing generation methods. ML is also used to generate test verdicts, property‐based, and expected output oracles. Supervised learning—often based on neural networks—and reinforcement learning—often based on Q‐learning—are common, and some publications also employ unsupervised or semi‐supervised learning. (Semi‐/Un‐)Supervised approaches are evaluated using both traditional testing metrics and ML‐related metrics (e.g., accuracy), while reinforcement learning is often evaluated using testing metrics tied to the reward function. The work‐to‐date shows great promise, but there are open challenges regarding training data, retraining, scalability, evaluation complexity, ML algorithms employed—and how they are applied—benchmarks, and replicability. Our findings can serve as a roadmap and inspiration for researchers in this field.
Förderung
- Vetenskapsrådet
Zitieren
APA
Fontes, A., & Gay, G. (2023). The integration of machine learning into automated test generation: A systematic mapping study. Software Testing, Verification and Reliability, 33(4). https://doi.org/10.1002/stvr.1845
Vancouver
Fontes A, Gay G. The integration of machine learning into automated test generation: A systematic mapping study. Software Testing, Verification and Reliability. 2023;33(4). doi:10.1002/stvr.1845
BibTeX
@article{Fontes2023,
author = {Fontes, Afonso and Gay, Gregory},
title = {The integration of machine learning into automated test generation: A systematic mapping study},
journal = {Software Testing, Verification and Reliability},
year = {2023},
volume = {33},
number = {4},
doi = {10.1002/stvr.1845}
}
EUVIMED