EUVIMEDEUVIMED entdecken
Crossref

Software Performance Engineering for Foundation Model-Powered Software

Haoxiang Zhang, Shi Chang, Arthur Leung, Kishanthan Thangarajah, Boyuan Chen, Hanan Lutfiyya, Ahmed E. Hassan

ACM Transactions on Software Engineering and Methodology · 25.03.2026

DOI: 10.1145/3794844 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Software Engineering and Methodology, online erschienen am 25.03.2026. Verfasst von Haoxiang Zhang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 103 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rise of Foundation Models (FMs) like Large Language Models (LLMs) is revolutionizing software development. Despite the impressive prototypes, transforming FMware into production-ready products demands complex engineering across various domains. A critical but overlooked aspect is performance engineering, which aims at ensuring FMware meets performance goals such as throughput and latency to avoid user dissatisfaction and financial loss. Often, performance considerations are an afterthought, leading to costly optimization efforts post-deployment. FMware’s high computational resource demands highlight the need for efficient hardware use. Continuous performance engineering is essential to prevent degradation. This paper highlights the significance of Software Performance Engineering (SPE) in FMware, identifying four key challenges: cognitive architecture design (i.e., the structural design that defines how AI components interact, reason, and interface with classical software components), communication protocols, tuning and optimization, and deployment. These challenges are based on literature surveys and experiences from developing an in-house FMware system. We discuss problems, current practices, and innovative paths for the software engineering community.

Zitieren

APA

Zhang, H., Chang, S., Leung, A., Thangarajah, K., Chen, B., Lutfiyya, H., & Hassan, A. E. (2026). Software Performance Engineering for Foundation Model-Powered Software. ACM Transactions on Software Engineering and Methodology. https://doi.org/10.1145/3794844

Vancouver

Zhang H, Chang S, Leung A, Thangarajah K, Chen B, Lutfiyya H, et al. Software Performance Engineering for Foundation Model-Powered Software. ACM Transactions on Software Engineering and Methodology. 2026. doi:10.1145/3794844

BibTeX
@article{Zhang2026,
  author = {Zhang, Haoxiang and Chang, Shi and Leung, Arthur and Thangarajah, Kishanthan and Chen, Boyuan and Lutfiyya, Hanan and Hassan, Ahmed E.},
  title = {Software Performance Engineering for Foundation Model-Powered Software},
  journal = {ACM Transactions on Software Engineering and Methodology},
  year = {2026},
  doi = {10.1145/3794844}
}
Kostenlos starten →