EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

THE EVOLUTION OF LARGE MODEL INFERENCE ARCHITECTURES: FROM CENTRALIZED CLOUDS TO DECENTRALIZED ON-DEVICE INTELLIGENCE

ZeYi Luo

Journal of Computer Science and Electrical Engineering · 03.07.2026 · 8 (5) · 1-5

DOI: 10.61784/jcsee3146 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Computer Science and Electrical Engineering, online erschienen am 03.07.2026. Verfasst von ZeYi Luo. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The proliferation of large-scale AI models, particularly Large Language Models (LLMs), has made inference a critical and resource-intensive workload. This survey provides a comprehensive review of the historical evolution of inference architectures, charting a distinct trajectory from centralized, cloud-native paradigms to fully decentralized, on-device intelligence. We systematically analyze four key architectural epochs: (1) Device-Cloud, (2) Device-Edge-Cloud, (3) Device-Edge, and (4) pure On-Device inference. For each paradigm, we conduct an in-depth examination of its dominant systems, key enabling technologies, and the inherent advantages and limitations that catalyzed the transition to the subsequent stage. Our analysis reveals that this evolution is driven by a persistent set of trade-offs between computational power, latency, data privacy, cost, and energy efficiency. This paper concludes that the future of AI inference lies not in a single monolithic architecture but in a heterogeneous "compute continuum," where workloads are dynamically orchestrated across a spectrum of resources to meet diverse application demands.

Zitieren

APA

Luo, Z. (2026). THE EVOLUTION OF LARGE MODEL INFERENCE ARCHITECTURES: FROM CENTRALIZED CLOUDS TO DECENTRALIZED ON-DEVICE INTELLIGENCE. Journal of Computer Science and Electrical Engineering, 8(5), 1-5. https://doi.org/10.61784/jcsee3146

Vancouver

Luo Z. THE EVOLUTION OF LARGE MODEL INFERENCE ARCHITECTURES: FROM CENTRALIZED CLOUDS TO DECENTRALIZED ON-DEVICE INTELLIGENCE. Journal of Computer Science and Electrical Engineering. 2026;8(5):1-5. doi:10.61784/jcsee3146

BibTeX
@article{Luo2026,
  author = {Luo, ZeYi},
  title = {THE EVOLUTION OF LARGE MODEL INFERENCE ARCHITECTURES: FROM CENTRALIZED CLOUDS TO DECENTRALIZED ON-DEVICE INTELLIGENCE},
  journal = {Journal of Computer Science and Electrical Engineering},
  year = {2026},
  volume = {8},
  number = {5},
  pages = {1--5},
  doi = {10.61784/jcsee3146}
}
Kostenlos starten →