Six years later: testing vs. model checking
International Journal on Software Tools for Technology Transfer · 2024-12 · 26 (6) · 633-646
DOI: 10.1007/s10009-024-00769-8 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal on Software Tools for Technology Transfer, online erschienen am 16.01.2025. Verfasst von Dirk Beyer und 1 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 115 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ludwig-Maximilians-Universität München.
Abstract (Originalsprache)
Six years ago, we performed the first large-scale comparison of automated test generators and software model checkers with respect to bug-finding capabilities on a benchmark set with 5693 C programs. Since then, the International Competition on Software Testing (Test-Comp) has established standardized formats and community-agreed rules for the experimental comparison of test generators. With this new context, it is time to revisit our initial question: Model checkers or test generators—which tools are more effective in finding bugs in software? To answer this, we perform a comparative analysis on the tools and existing data published by two competitions, the International Competition on Software Verification (SV-COMP) and Test-Comp. The results provide two insights: (1) Almost all test generators that participate in Test-Comp use hybrid approaches that include formal methods, and (2) although the considered model checkers are still highly competitive, they are now outperformed by the bug-finding capabilities of the considered test generators.
Förderung
- Ludwig-Maximilians-Universität München
Zitieren
APA
Beyer, D., & Lemberger, T. (2024). Six years later: testing vs. model checking. International Journal on Software Tools for Technology Transfer, 26(6), 633-646. https://doi.org/10.1007/s10009-024-00769-8
Vancouver
Beyer D, Lemberger T. Six years later: testing vs. model checking. International Journal on Software Tools for Technology Transfer. 2024;26(6):633-646. doi:10.1007/s10009-024-00769-8
BibTeX
@article{Beyer2024,
author = {Beyer, Dirk and Lemberger, Thomas},
title = {Six years later: testing vs. model checking},
journal = {International Journal on Software Tools for Technology Transfer},
year = {2024},
volume = {26},
number = {6},
pages = {633--646},
doi = {10.1007/s10009-024-00769-8}
}
EUVIMED