Random or evolutionary search for object‐oriented test suite generation?
Software Testing, Verification and Reliability · 2018-06 · 28 (4)
DOI: 10.1002/stvr.1660 ↗Kurz gefasst
Fachartikel in der Zeitschrift Software Testing, Verification and Reliability, online erschienen am 30.03.2018. Verfasst von Sina Shamshiri und 6 weiteren Autor:innen. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 52 Literaturangaben. Gefördert von: Fonds National de la Recherche Luxembourg.
Abstract (Originalsprache)
An important aim in software testing is constructing a test suite with high structural code coverage, that is, ensuring that most if not all of the code under test have been executed by the test cases comprising the test suite. Several search‐based techniques have proved successful at automatically generating tests that achieve high coverage. However, despite the well‐established arguments behind using evolutionary search algorithms (eg, genetic algorithms) in preference to random search, it remains an open question whether the benefits can actually be observed in practice when generating unit test suites for object‐oriented classes. In this paper, we report an empirical study on the effects of using evolutionary algorithms (including a genetic algorithm and chemical reaction optimization) to generate test suites, compared with generating test suites incrementally with random search. We apply the E VO S UITE unit test suite generator to 1000 classes randomly selected from the SF110 corpus of open‐source projects. Surprisingly, the results show that the difference is much smaller than one might expect: While evolutionary search covers more branches of the type where standard fitness functions provide guidance, we observed that, in practice, the vast majority of branches do not provide any guidance to the search. These results suggest that, although evolutionary algorithms are more effective at covering complex branches, a random search may suffice to achieve high coverage of most object‐oriented classes.
Förderung
- Fonds National de la Recherche Luxembourg
Zitieren
APA
Shamshiri, S., Rojas, J. M., Gazzola, L., Fraser, G., McMinn, P., Mariani, L., & Arcuri, A. (2018). Random or evolutionary search for object‐oriented test suite generation?. Software Testing, Verification and Reliability, 28(4). https://doi.org/10.1002/stvr.1660
Vancouver
Shamshiri S, Rojas JM, Gazzola L, Fraser G, McMinn P, Mariani L, et al. Random or evolutionary search for object‐oriented test suite generation?. Software Testing, Verification and Reliability. 2018;28(4). doi:10.1002/stvr.1660
BibTeX
@article{Shamshiri2018,
author = {Shamshiri, Sina and Rojas, José Miguel and Gazzola, Luca and Fraser, Gordon and McMinn, Phil and Mariani, Leonardo and Arcuri, Andrea},
title = {Random or evolutionary search for object‐oriented test suite generation?},
journal = {Software Testing, Verification and Reliability},
year = {2018},
volume = {28},
number = {4},
doi = {10.1002/stvr.1660}
}
EUVIMED