EUVIMEDEUVIMED entdecken
Crossref

CoverUp: Effective High Coverage Test Generation for Python

Juan Altmayer Pizzorno, Emery D. Berger

Proceedings of the ACM on Software Engineering · 19.06.2025 · 2 (FSE) · 2897-2919

DOI: 10.1145/3729398 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Software Engineering, online erschienen am 19.06.2025. Verfasst von Juan Altmayer Pizzorno und 1 weiteren Autor:innen. Die Arbeit wurde bisher 67-mal zitiert (Crossref) und nennt 42 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Testing is an essential part of software development. Test generation tools attempt to automate the otherwise labor-intensive task of test creation, but generating high-coverage tests remains challenging. This paper proposes Cover Up, a novel approach to driving the generation of high-coverage Python regression tests. Cover Up combines coverage analysis, code context, and feedback in prompts that iteratively guide the LLM to generate tests that improve line and branch coverage. We evaluate our prototype Cover Up implementation across a benchmark of challenging code derived from open-source Python projects and show that Cover Up substantially improves on the state of the art. Compared to CodaMosa , a hybrid search/LLM-based test generator, Cover Up achieves a per-module median line+branch coverage of 80% (vs. 47%). Compared to MuTAP, a mutation- and LLM-based test generator, Cover Up achieves an overall line+branch coverage of 89% (vs. 77%). We also demonstrate that CoverUp’s performance stems not only from the LLM used but from the combined effectiveness of its components.

Zitieren

APA

Pizzorno, J. A., & Berger, E. D. (2025). CoverUp: Effective High Coverage Test Generation for Python. Proceedings of the ACM on Software Engineering, 2(FSE), 2897-2919. https://doi.org/10.1145/3729398

Vancouver

Pizzorno JA, Berger ED. CoverUp: Effective High Coverage Test Generation for Python. Proceedings of the ACM on Software Engineering. 2025;2(FSE):2897-2919. doi:10.1145/3729398

BibTeX
@article{Pizzorno2025,
  author = {Pizzorno, Juan Altmayer and Berger, Emery D.},
  title = {CoverUp: Effective High Coverage Test Generation for Python},
  journal = {Proceedings of the ACM on Software Engineering},
  year = {2025},
  volume = {2},
  number = {FSE},
  pages = {2897--2919},
  doi = {10.1145/3729398}
}
Kostenlos starten →