Optimization of GPU-Based Deployment Strategies for Large Language Models in E-Commerce Platforms
International Journal of Engineering and Innovative Research · 02.06.2026 · 8 (1) · 33-42
DOI: 10.47933/ijeir.1898082 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Engineering and Innovative Research, online erschienen am 02.06.2026. Verfasst von Emre Tekelioğlu und 1 weiteren Autor:innen. Die Arbeit nennt 15 Literaturangaben.
Abstract (Originalsprache)
In e-commerce platforms, millions of product–offer matchings are performed daily, which requires scalable and efficient solutions beyond traditional methods. This study aims to improve the deployment performance of Large Language Models (LLMs) in high-volume data matching processes. In this context, the Turkish BERT model was converted into the ONNX format, and the model size was reduced from 1.2 GB to 200–300 MB, thereby enhancing deployment efficiency. The performance of the model was comparatively evaluated across five different deployment infrastructures: NVIDIA Triton Inference Server, BentoML, Jina AI, LightningLite, and FastAPI (GPU). The results demonstrate that Triton Inference Server provides superior performance compared to other solutions, with its high throughput capacity and low latency. Furthermore, migrating from CPU to GPU achieved an approximately 70% improvement in response times and a reduction in operational costs. Future work will focus on automating model updates and orchestrating multiple models.
Zitieren
APA
Tekelioğlu, E., & Derin, U. (2026). Optimization of GPU-Based Deployment Strategies for Large Language Models in E-Commerce Platforms. International Journal of Engineering and Innovative Research, 8(1), 33-42. https://doi.org/10.47933/ijeir.1898082
Vancouver
Tekelioğlu E, Derin U. Optimization of GPU-Based Deployment Strategies for Large Language Models in E-Commerce Platforms. International Journal of Engineering and Innovative Research. 2026;8(1):33-42. doi:10.47933/ijeir.1898082
BibTeX
@article{Tekeliolu2026,
author = {Tekelioğlu, Emre and Derin, Ulaş},
title = {Optimization of GPU-Based Deployment Strategies for Large Language Models in E-Commerce Platforms},
journal = {International Journal of Engineering and Innovative Research},
year = {2026},
volume = {8},
number = {1},
pages = {33--42},
doi = {10.47933/ijeir.1898082}
}
EUVIMED