Choosing the Right Test Generation Tool: A Guide for Software Practitioners
JUCS - Journal of Universal Computer Science · 28.06.2026 · 32 (6) · 763-797
DOI: 10.3897/jucs.136861 ↗Kurz gefasst
Fachartikel in der Zeitschrift JUCS - Journal of Universal Computer Science, online erschienen am 28.06.2026. Verfasst von Edna Dias Canedo und 3 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-ND 4.0).
Abstract (Originalsprache)
Context
As software systems become increasingly complex, testing automation plays a critical role in ensuring product quality and reliability. However, the wide variety of available test generation tools with distinct purposes, features, and approaches makes it difficult for practitioners to select the most appropriate option for their projects. Goal: This study aims to identify, analyze, and compare test generation tools reported in both academic and industrial contexts, providing a practical reference guide to support software professionals in tool selection decisions.
Method
We conducted a Multivocal Literature Review (MLR) complemented by a two-round survey with 87 software practitioners. The MLR identified tools and features reported in white and grey literature, while the survey assessed practitioners’ familiarity, usage, and perceptions of advantages and challenges associated with these tools.
Results
The findings reveal a persistent gap between academic proposals and industrial adoption. While tools such as Postman, Selenium, and Cypress are among the most widely used tools in practice, academic tools like Monkey and Dynodroid remain rarely adopted. Practitioners value visibility, integration, and traceability as key features, whereas inconsistency and maintenance effort are seen as primary challenges.
Conclusions
The study contributes a structured reference guide to assist professionals in selecting tools suitable for specific testing contexts. It also provides insights for researchers aiming to align future tool development with industry needs, fostering better usability, integration, and sustainability of automated testing solutions.
Zitieren
APA
Canedo, E. D., Oliveira, G. M. D. R. D., Mendes, F. F., & Bedin, H. A. T. (2026). Choosing the Right Test Generation Tool: A Guide for Software Practitioners. JUCS - Journal of Universal Computer Science, 32(6), 763-797. https://doi.org/10.3897/jucs.136861
Vancouver
Canedo ED, Oliveira GMDRD, Mendes FF, Bedin HAT. Choosing the Right Test Generation Tool: A Guide for Software Practitioners. JUCS - Journal of Universal Computer Science. 2026;32(6):763-797. doi:10.3897/jucs.136861
BibTeX
@article{Canedo2026,
author = {Canedo, Edna Dias and Oliveira, Gabriel Matheus da Rocha de and Mendes, Fabiana Freitas and Bedin, Heloise Acco Tives},
title = {Choosing the Right Test Generation Tool: A Guide for Software Practitioners},
journal = {JUCS - Journal of Universal Computer Science},
year = {2026},
volume = {32},
number = {6},
pages = {763--797},
doi = {10.3897/jucs.136861}
}
EUVIMED