Integrating Large Language Model APIs into Enterprise Backend Services: Design Patterns and REST API Considerations
International Journal of Computational and Experimental Science and Engineering · 27.09.2023 · 9 (4)
DOI: 10.22399/ijcesen.5195 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computational and Experimental Science and Engineering, online erschienen am 27.09.2023. Verfasst von Prem Reddy Nomula. Die Arbeit nennt 21 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Large language models (LLMs) have rapidly evolved from experimental research artifacts into production-grade services that are widely accessible through RESTful APIs. Although these interfaces share structural similarities with conventional web services, their underlying characteristics—such as probabilistic outputs, token-based cost models, and high, variable latency—introduce fundamentally new challenges for enterprise system design. This paper presents a structured taxonomy of integration patterns for incorporating LLM APIs into enterprise backend architectures. Adopting a design science research methodology, the study derives and formalizes five core patterns—Gateway, Prompt Template, Retry and Fallback, Streaming Response, and Context Window Management—each addressing a distinct set of engineering concerns specific to LLM-based systems. In addition, the paper provides a comparative analysis of LLM APIs and traditional REST services, highlighting key architectural divergences. It further proposes observability and data governance strategies tailored to the operational realities of LLM integration. The applicability of the proposed patterns is demonstrated through a case-based validation, and practical implementation guidance is provided within the context of Java and Spring Boot environments. Together, these contributions offer a comprehensive framework for designing scalable, reliable, and compliant enterprise systems that leverage LLM capabilities.
Zitieren
APA
Nomula, P. R. (2023). Integrating Large Language Model APIs into Enterprise Backend Services: Design Patterns and REST API Considerations. International Journal of Computational and Experimental Science and Engineering, 9(4). https://doi.org/10.22399/ijcesen.5195
Vancouver
Nomula PR. Integrating Large Language Model APIs into Enterprise Backend Services: Design Patterns and REST API Considerations. International Journal of Computational and Experimental Science and Engineering. 2023;9(4). doi:10.22399/ijcesen.5195
BibTeX
@article{Nomula2023,
author = {Nomula, Prem Reddy},
title = {Integrating Large Language Model APIs into Enterprise Backend Services: Design Patterns and REST API Considerations},
journal = {International Journal of Computational and Experimental Science and Engineering},
year = {2023},
volume = {9},
number = {4},
doi = {10.22399/ijcesen.5195}
}
EUVIMED