A Reference Architecture for Scalable, Reliable, and GPU-Optimized AI Model Execution on Kubernetes
International Journal of Innovative Science and Research Technology · 11.06.2026 · 4018
DOI: 10.38124/ijisrt/26may1495 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Innovative Science and Research Technology, online erschienen am 11.06.2026. Verfasst von Shekar Rao Lakavath. Die Arbeit nennt 16 Literaturangaben.
Abstract (Originalsprache)
AI inference workloads stress infrastructure through bursty demand, long model initialization times, heterogeneous GPU requirements, and strict latency constraints. Kubernetes provides a programmable control plane for deployment, scaling, scheduling, and recovery, making it a strong substrate for production inference. This paper introduces KARB (Kubernetes AI Reliability Blueprint), a reference architecture and decision framework that connects service-level objectives (SLOs) to GPU-aware placement, multi-layer autoscaling, and governance controls. We explain GPU scheduling via device plugins, node labels, taints/tolerations, and optional GPU sharing strategies (MIG or time-slicing). We also present a unified scaling approach combining Horizontal Pod Autoscaler (HPA), KEDA event-driven scaling, and node autoscaling to control latency while minimizing GPU cost. Finally, we outline Kubernetes-native MLOps integration using Kubeflow Pipelines and KServe and provide reproducible templates and checklists suitable for enterprise platform engineering teams.
Zitieren
APA
Lakavath, S. R. (2026). A Reference Architecture for Scalable, Reliable, and GPU-Optimized AI Model Execution on Kubernetes. International Journal of Innovative Science and Research Technology, 4018. https://doi.org/10.38124/ijisrt/26may1495
Vancouver
Lakavath SR. A Reference Architecture for Scalable, Reliable, and GPU-Optimized AI Model Execution on Kubernetes. International Journal of Innovative Science and Research Technology. 2026:4018. doi:10.38124/ijisrt/26may1495
BibTeX
@article{Lakavath2026,
author = {Lakavath, Shekar Rao},
title = {A Reference Architecture for Scalable, Reliable, and GPU-Optimized AI Model Execution on Kubernetes},
journal = {International Journal of Innovative Science and Research Technology},
year = {2026},
pages = {4018},
doi = {10.38124/ijisrt/26may1495}
}
EUVIMED