Generating Architecture-Agnostic Performance Tests from Functional Unit Tests
ACM Transactions on Modeling and Performance Evaluation of Computing Systems · 30.06.2026 · 11 (1-2) · 1-24
DOI: 10.1145/3801098 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Modeling and Performance Evaluation of Computing Systems, online erschienen am 22.04.2026. Verfasst von Daniel Vega Rodriguez und 3 weiteren Autor:innen. Die Arbeit nennt 52 Literaturangaben. Gefördert von: Deutsche Forschungsgemeinschaft, Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung, Hasler Stiftung.
Abstract (Originalsprache)
We present a methodology for automated performance regression testing at the unit level, designed to integrate seamlessly into the development workflow of high-performance computing (HPC) applications. The proposed framework emphasizes the integration of performance tests with existing functional unit tests by leveraging their shared structure, thereby enabling the development of performance test suites with minimal developer effort and supporting the early detection of performance degradations. As a proof of concept, we implement and release the framework as a publicly available Julia package. It generates architecture-agnostic test suites that remain valid across heterogeneous hardware environments. To demonstrate its effectiveness, we apply it to representative HPC use cases, including memory throughput analysis in stencil-based computations and roofline modeling of a sparse linear system solver. Experiments conducted on a diverse set of CPU and GPU architectures confirm the framework’s ability to detect performance regressions consistently, validating its potential for use in continuous performance testing pipelines.
Förderung
- Deutsche Forschungsgemeinschaft
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung
- Hasler Stiftung
Zitieren
APA
Rodriguez, D. V., Omlin, S., Pasadakis, D., & Schenk, O. (2026). Generating Architecture-Agnostic Performance Tests from Functional Unit Tests. ACM Transactions on Modeling and Performance Evaluation of Computing Systems, 11(1-2), 1-24. https://doi.org/10.1145/3801098
Vancouver
Rodriguez DV, Omlin S, Pasadakis D, Schenk O. Generating Architecture-Agnostic Performance Tests from Functional Unit Tests. ACM Transactions on Modeling and Performance Evaluation of Computing Systems. 2026;11(1-2):1-24. doi:10.1145/3801098
BibTeX
@article{Rodriguez2026,
author = {Rodriguez, Daniel Vega and Omlin, Samuel and Pasadakis, Dimosthenis and Schenk, Olaf},
title = {Generating Architecture-Agnostic Performance Tests from Functional Unit Tests},
journal = {ACM Transactions on Modeling and Performance Evaluation of Computing Systems},
year = {2026},
volume = {11},
number = {1-2},
pages = {1--24},
doi = {10.1145/3801098}
}
EUVIMED