EUVIMEDEUVIMED entdecken
Crossref

A Reference Architecture for Scalable, Reliable, and GPU-Optimized AI Model Execution on Kubernetes

Shekar Rao Lakavath

International Journal of Innovative Science and Research Technology · 11.06.2026 · 4018

DOI: 10.38124/ijisrt/26may1495 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Innovative Science and Research Technology, online erschienen am 11.06.2026. Verfasst von Shekar Rao Lakavath. Die Arbeit nennt 16 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

AI inference workloads stress infrastructure through bursty demand, long model initialization times, heterogeneous GPU requirements, and strict latency constraints. Kubernetes provides a programmable control plane for deployment, scaling, scheduling, and recovery, making it a strong substrate for production inference. This paper introduces KARB (Kubernetes AI Reliability Blueprint), a reference architecture and decision framework that connects service-level objectives (SLOs) to GPU-aware placement, multi-layer autoscaling, and governance controls. We explain GPU scheduling via device plugins, node labels, taints/tolerations, and optional GPU sharing strategies (MIG or time-slicing). We also present a unified scaling approach combining Horizontal Pod Autoscaler (HPA), KEDA event-driven scaling, and node autoscaling to control latency while minimizing GPU cost. Finally, we outline Kubernetes-native MLOps integration using Kubeflow Pipelines and KServe and provide reproducible templates and checklists suitable for enterprise platform engineering teams.

Zitieren

APA

Lakavath, S. R. (2026). A Reference Architecture for Scalable, Reliable, and GPU-Optimized AI Model Execution on Kubernetes. International Journal of Innovative Science and Research Technology, 4018. https://doi.org/10.38124/ijisrt/26may1495

Vancouver

Lakavath SR. A Reference Architecture for Scalable, Reliable, and GPU-Optimized AI Model Execution on Kubernetes. International Journal of Innovative Science and Research Technology. 2026:4018. doi:10.38124/ijisrt/26may1495

BibTeX
@article{Lakavath2026,
  author = {Lakavath, Shekar Rao},
  title = {A Reference Architecture for Scalable, Reliable, and GPU-Optimized AI Model Execution on Kubernetes},
  journal = {International Journal of Innovative Science and Research Technology},
  year = {2026},
  pages = {4018},
  doi = {10.38124/ijisrt/26may1495}
}
Kostenlos starten →