EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

A Comparative Evaluation of Large Language Models for Enterprise Deployment: Performance, Safety, Cost, and Scalability Using a Multi-Criteria Decision Framework

Erarda Vuka, Jurgen Mecaj

MIREJ: Multidisciplinary Innovation Research Journal · 28.07.2026 · 2 (2) · 1-13

DOI: 10.70152/mirej.v2i2.350 ↗

Kurz gefasst

Fachartikel in der Zeitschrift MIREJ: Multidisciplinary Innovation Research Journal, online erschienen am 28.07.2026. Verfasst von Erarda Vuka und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The proliferation of large language models (LLMs) across enterprise, research, and public-sector applications has created an urgent need for rigorous, multi-dimensional evaluation frameworks. This paper presents a comprehensive comparative analysis of seven state-of-the-art LLMs — GPT-4o, Claude 3.5 Sonnet, Gemini 1.5 Pro and Flash, LLaMA 3 70B, Mistral Large, and Claude 3 Haiku — across eight evaluation dimensions: benchmark accuracy, safety alignment, cost efficiency, inference latency, context handling, deployment flexibility, multilingual capability, and scalability. A weighted Multi-Criteria Decision Analysis (MCDA) framework is applied to produce transparent composite rankings from empirical benchmark data using five standardized benchmarks (MMLU, HumanEval, HellaSwag, GSM8K, MATH). Results indicate that Claude 3.5 Sonnet achieves the highest MCDA composite score (0.801), driven by accuracy (90.4% MMLU, 92.0% HumanEval) and safety alignment (4.9/5). Gemini 1.5 Flash emerges as optimal for cost-sensitive deployments ($0.075/1M tokens; 210 tok/s). The paper analyzes architectural trade-offs between dense transformers and Mixture-of-Experts designs, provides a deployment recommendation matrix, and contributes an extensible, evidence-based decision framework for enterprise AI practitioners.

Zitieren

APA

Vuka, E., & Mecaj, J. (2026). A Comparative Evaluation of Large Language Models for Enterprise Deployment: Performance, Safety, Cost, and Scalability Using a Multi-Criteria Decision Framework. MIREJ: Multidisciplinary Innovation Research Journal, 2(2), 1-13. https://doi.org/10.70152/mirej.v2i2.350

Vancouver

Vuka E, Mecaj J. A Comparative Evaluation of Large Language Models for Enterprise Deployment: Performance, Safety, Cost, and Scalability Using a Multi-Criteria Decision Framework. MIREJ: Multidisciplinary Innovation Research Journal. 2026;2(2):1-13. doi:10.70152/mirej.v2i2.350

BibTeX
@article{Vuka2026,
  author = {Vuka, Erarda and Mecaj, Jurgen},
  title = {A Comparative Evaluation of Large Language Models for Enterprise Deployment: Performance, Safety, Cost, and Scalability Using a Multi-Criteria Decision Framework},
  journal = {MIREJ: Multidisciplinary Innovation Research Journal},
  year = {2026},
  volume = {2},
  number = {2},
  pages = {1--13},
  doi = {10.70152/mirej.v2i2.350}
}
Kostenlos starten →