EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Six years later: testing vs. model checking

Dirk Beyer, Thomas Lemberger

International Journal on Software Tools for Technology Transfer · 2024-12 · 26 (6) · 633-646

DOI: 10.1007/s10009-024-00769-8 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal on Software Tools for Technology Transfer, online erschienen am 16.01.2025. Verfasst von Dirk Beyer und 1 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 115 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ludwig-Maximilians-Universität München.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Six years ago, we performed the first large-scale comparison of automated test generators and software model checkers with respect to bug-finding capabilities on a benchmark set with 5693 C programs. Since then, the International Competition on Software Testing (Test-Comp) has established standardized formats and community-agreed rules for the experimental comparison of test generators. With this new context, it is time to revisit our initial question: Model checkers or test generators—which tools are more effective in finding bugs in software? To answer this, we perform a comparative analysis on the tools and existing data published by two competitions, the International Competition on Software Verification (SV-COMP) and Test-Comp. The results provide two insights: (1) Almost all test generators that participate in Test-Comp use hybrid approaches that include formal methods, and (2) although the considered model checkers are still highly competitive, they are now outperformed by the bug-finding capabilities of the considered test generators.

Förderung

  • Ludwig-Maximilians-Universität München

Zitieren

APA

Beyer, D., & Lemberger, T. (2024). Six years later: testing vs. model checking. International Journal on Software Tools for Technology Transfer, 26(6), 633-646. https://doi.org/10.1007/s10009-024-00769-8

Vancouver

Beyer D, Lemberger T. Six years later: testing vs. model checking. International Journal on Software Tools for Technology Transfer. 2024;26(6):633-646. doi:10.1007/s10009-024-00769-8

BibTeX
@article{Beyer2024,
  author = {Beyer, Dirk and Lemberger, Thomas},
  title = {Six years later: testing vs. model checking},
  journal = {International Journal on Software Tools for Technology Transfer},
  year = {2024},
  volume = {26},
  number = {6},
  pages = {633--646},
  doi = {10.1007/s10009-024-00769-8}
}
Kostenlos starten →