Heterogeneous Confidential Computing System for Large Language Models: A Survey
ACM Transactions on Architecture and Code Optimization · 31.03.2026 · 23 (1) · 1-26
DOI: 10.1145/3779307 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Architecture and Code Optimization, online erschienen am 22.03.2026. Verfasst von Hao Lan und 7 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 95 Literaturangaben.
Abstract (Originalsprache)
The rapid progress of large language models (LLMs) has driven their deployment on heterogeneous computing platforms using accelerators such as GPUs and NPUs to meet growing computational demands. However, this paradigm transition introduces critical security and privacy risks that are uniquely intensified by the characteristics of LLM workloads. These models embed high intellectual property value, making them prime targets for adversaries. Furthermore, their autoregressive generation process makes them exceptionally sensitive to latency, magnifying the performance impact of any security overhead. Existing confidential computing solutions are predominantly CPU-centric, leaving critical computation on accelerators unprotected. This article provides a survey of technologies for securing LLMs on heterogeneous confidential computing platforms. We analyze the threat landscape of heterogeneous LLM deployment, identifying risks across hardware interconnects, complex software stacks, and LLM-specific properties. These risks include data leakage during transfer, interference in multi-tenant execution, and limited trust in accelerator components. To address these challenges, we review key enabling technologies including secure I/O, tenant isolation, and device attestation, which together form the foundation for building trusted execution paths across heterogeneous platforms. We evaluate representative academic and industrial systems for GPUs and NPUs, summarizing their protection strategies and current limitations. Finally, we highlight open research directions such as fine-grained protection of LLM runtime state, low-overhead cryptographic engines, and formal methods for building verifiable systems. Our goal is to support secure and efficient LLM execution through the integration of confidential computing as a foundational element in heterogeneous system design.
Zitieren
APA
Lan, H., Zhou, Z., Zhu, Q., Yan, W., Hao, Q., Ye, X., Liu, Y., & Sun, N. (2026). Heterogeneous Confidential Computing System for Large Language Models: A Survey. ACM Transactions on Architecture and Code Optimization, 23(1), 1-26. https://doi.org/10.1145/3779307
Vancouver
Lan H, Zhou Z, Zhu Q, Yan W, Hao Q, Ye X, et al. Heterogeneous Confidential Computing System for Large Language Models: A Survey. ACM Transactions on Architecture and Code Optimization. 2026;23(1):1-26. doi:10.1145/3779307
BibTeX
@article{Lan2026,
author = {Lan, Hao and Zhou, Ziang and Zhu, Qi and Yan, Wei and Hao, Qinfen and Ye, Xiaochun and Liu, Yong and Sun, Ninghui},
title = {Heterogeneous Confidential Computing System for Large Language Models: A Survey},
journal = {ACM Transactions on Architecture and Code Optimization},
year = {2026},
volume = {23},
number = {1},
pages = {1--26},
doi = {10.1145/3779307}
}
EUVIMED