Are concurrency coverage metrics effective for testing: a comprehensive empirical investigation
Software Testing, Verification and Reliability · 2015-06 · 25 (4) · 334-370
DOI: 10.1002/stvr.1539 ↗Kurz gefasst
Fachartikel in der Zeitschrift Software Testing, Verification and Reliability, online erschienen am 23.06.2014. Verfasst von Shin Hong und 4 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 34 Literaturangaben. Gefördert von: National Science Foundation, Air Force Office of Scientific Research, Fonds National de la Recherche Luxembourg.
Abstract (Originalsprache)
Testing multithreaded programs is inherently challenging, as programs can exhibit numerous thread interactions. To help engineers test these programs cost‐effectively, researchers have proposed concurrency coverage metrics. These metrics are intended to be used as predictors for testing effectiveness and provide targets for test generation. The effectiveness of these metrics, however, remains largely unexamined. In this work, we explore the impact of concurrency coverage metrics on testing effectiveness and examine the relationship between coverage, fault detection, and test suite size. We study eight existing concurrency coverage metrics and six new metrics formed by combining complementary metrics. Our results indicate that the metrics are moderate to strong predictors of testing effectiveness and effective at providing test generation targets. Nevertheless, metric effectiveness varies across programs, and even combinations of complementary metrics do not consistently provide effective testing. These results highlight the need for additional work on concurrency coverage metrics. Copyright © 2014 John Wiley & Sons, Ltd.
Förderung
- National Science Foundation
- Air Force Office of Scientific Research
- Fonds National de la Recherche Luxembourg
- Ministry of Education, Science and Technology (MEST) through the National Research Foundation of Korea (NRF)
- Ministry of Knowledge and Economy/Korea Evaluation Institute of Industrial Technology (MKE/KEIT)
- Ministry of Science, ICT and Future Planning (MSIP) through the National IT Industry Promotion Agency (NIPA)
- Ministry of Science, ICT and Future Planning (MSIP) through the National Research Foundation of Korea (NRF)
Zitieren
APA
Hong, S., Staats, M., Ahn, J., Kim, M., & Rothermel, G. (2015). Are concurrency coverage metrics effective for testing: a comprehensive empirical investigation. Software Testing, Verification and Reliability, 25(4), 334-370. https://doi.org/10.1002/stvr.1539
Vancouver
Hong S, Staats M, Ahn J, Kim M, Rothermel G. Are concurrency coverage metrics effective for testing: a comprehensive empirical investigation. Software Testing, Verification and Reliability. 2015;25(4):334-370. doi:10.1002/stvr.1539
BibTeX
@article{Hong2015,
author = {Hong, Shin and Staats, Matt and Ahn, Jaemin and Kim, Moonzoo and Rothermel, Gregg},
title = {Are concurrency coverage metrics effective for testing: a comprehensive empirical investigation},
journal = {Software Testing, Verification and Reliability},
year = {2015},
volume = {25},
number = {4},
pages = {334--370},
doi = {10.1002/stvr.1539}
}
EUVIMED