A Comparative Evaluation of Large Language Models for Enterprise Deployment: Performance, Safety, Cost, and Scalability Using a Multi-Criteria Decision Framework
MIREJ: Multidisciplinary Innovation Research Journal · 28.07.2026 · 2 (2) · 1-13
DOI: 10.70152/mirej.v2i2.350 ↗Kurz gefasst
Fachartikel in der Zeitschrift MIREJ: Multidisciplinary Innovation Research Journal, online erschienen am 28.07.2026. Verfasst von Erarda Vuka und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Abstract (Originalsprache)
The proliferation of large language models (LLMs) across enterprise, research, and public-sector applications has created an urgent need for rigorous, multi-dimensional evaluation frameworks. This paper presents a comprehensive comparative analysis of seven state-of-the-art LLMs — GPT-4o, Claude 3.5 Sonnet, Gemini 1.5 Pro and Flash, LLaMA 3 70B, Mistral Large, and Claude 3 Haiku — across eight evaluation dimensions: benchmark accuracy, safety alignment, cost efficiency, inference latency, context handling, deployment flexibility, multilingual capability, and scalability. A weighted Multi-Criteria Decision Analysis (MCDA) framework is applied to produce transparent composite rankings from empirical benchmark data using five standardized benchmarks (MMLU, HumanEval, HellaSwag, GSM8K, MATH). Results indicate that Claude 3.5 Sonnet achieves the highest MCDA composite score (0.801), driven by accuracy (90.4% MMLU, 92.0% HumanEval) and safety alignment (4.9/5). Gemini 1.5 Flash emerges as optimal for cost-sensitive deployments ($0.075/1M tokens; 210 tok/s). The paper analyzes architectural trade-offs between dense transformers and Mixture-of-Experts designs, provides a deployment recommendation matrix, and contributes an extensible, evidence-based decision framework for enterprise AI practitioners.
Zitieren
APA
Vuka, E., & Mecaj, J. (2026). A Comparative Evaluation of Large Language Models for Enterprise Deployment: Performance, Safety, Cost, and Scalability Using a Multi-Criteria Decision Framework. MIREJ: Multidisciplinary Innovation Research Journal, 2(2), 1-13. https://doi.org/10.70152/mirej.v2i2.350
Vancouver
Vuka E, Mecaj J. A Comparative Evaluation of Large Language Models for Enterprise Deployment: Performance, Safety, Cost, and Scalability Using a Multi-Criteria Decision Framework. MIREJ: Multidisciplinary Innovation Research Journal. 2026;2(2):1-13. doi:10.70152/mirej.v2i2.350
BibTeX
@article{Vuka2026,
author = {Vuka, Erarda and Mecaj, Jurgen},
title = {A Comparative Evaluation of Large Language Models for Enterprise Deployment: Performance, Safety, Cost, and Scalability Using a Multi-Criteria Decision Framework},
journal = {MIREJ: Multidisciplinary Innovation Research Journal},
year = {2026},
volume = {2},
number = {2},
pages = {1--13},
doi = {10.70152/mirej.v2i2.350}
}
EUVIMED