EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Automated Knowledge-Aware Test Reuse

Ziyuan Zhang, Yi Gao, Xing Hu, Xin Xia, Shanping Li

Proceedings of the ACM on Software Engineering · 30.06.2026 · 3 (FSE) · 3138-3161

DOI: 10.1145/3808146 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Software Engineering, online erschienen am 30.06.2026. Verfasst von Ziyuan Zhang und 4 weiteren Autor:innen. Die Arbeit nennt 80 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key R&D Program of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The quality of foundational libraries is critical to the reliability of modern software ecosystems. However, developers often do not have enough time to test for various reasons. Recent studies show that 68% of deep learning libraries lack unit tests and their absence negatively impacts libraries' health. While automated test generation techniques have been proposed, they frequently produce invalid inputs or semantically inconsistent assertions due to missing domain knowledge. An alternative is cross-library test reuse, as many libraries in scientific computing and machine learning expose functionally similar APIs. Nevertheless, effective test reuse requires careful semantic alignment rather than naive "copy-and-paste", as subtle API mismatches and incomplete domain knowledge often yield invalid tests. To address these challenges, we present KATRER, a knowledge-aware framework for automated test reuse. KATRER models each library as a heterogeneous graph that integrates semantic and structural information and introduces a Test Fingerprint representation for tests, which captures code, docstrings, usage examples, pre-/post-conditions, and invoked APIs. This enables accurate API alignment and prevents invalid calls. KATRER further employs a collaborative LLM pipeline that verifies semantic compatibility, performs stepwise API substitution, and validates test correctness. We evaluated KATRER among five libraries in two domains, generating 13,191 sub-tests from 1,484 source tests, with 7,257 retained after filtering. KATRER improves both PassRate@1 and TFC@1 by 14.46%, while uncovering 22 previously unknown defects in CuPy and cuML, 8 of which have already been fixed. These results demonstrate that knowledge-aware test reuse substantially reduces manual adaptation effort and enhances the robustness of widely used libraries.

Förderung

  • National Key R&D Program of China

Zitieren

APA

Zhang, Z., Gao, Y., Hu, X., Xia, X., & Li, S. (2026). Automated Knowledge-Aware Test Reuse. Proceedings of the ACM on Software Engineering, 3(FSE), 3138-3161. https://doi.org/10.1145/3808146

Vancouver

Zhang Z, Gao Y, Hu X, Xia X, Li S. Automated Knowledge-Aware Test Reuse. Proceedings of the ACM on Software Engineering. 2026;3(FSE):3138-3161. doi:10.1145/3808146

BibTeX
@article{Zhang2026,
  author = {Zhang, Ziyuan and Gao, Yi and Hu, Xing and Xia, Xin and Li, Shanping},
  title = {Automated Knowledge-Aware Test Reuse},
  journal = {Proceedings of the ACM on Software Engineering},
  year = {2026},
  volume = {3},
  number = {FSE},
  pages = {3138--3161},
  doi = {10.1145/3808146}
}
Kostenlos starten →