EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

Diagnostic Accuracy of Four Large Language Models for the Cipto Triage Method: A Comparative Evaluation for Emergency Department Triage in Resource-Limited Settings

Ahmad Ridwan Fauzi, Adelia Chitra Sazkia, Muhammad Ardiansyah

Journal of Electronics, Electromedical Engineering, and Medical Informatics · 30.10.2026 · 8 (4) · 1735-1752

DOI: 10.35882/jeeemi.v8i4.2022 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Electronics, Electromedical Engineering, and Medical Informatics, online erschienen am 30.10.2026. Verfasst von Ahmad Ridwan Fauzi und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Triage accuracy remains suboptimal globally, particularly in developing countries employing simplified systems such as the Cipto Triage Method (CTM), and LLM performance on three-level triage systems in non-English contexts has not been evaluated. This study evaluated the diagnostic accuracy of four LLMs (DeepSeek V4 Pro, DeepSeek V4 Flash, Tencent Hy3, MiMo V2.5) for CTM classification as decision support tools for emergency department (ED) triage in resource-limited settings. The models were tested on a stratified random sample of 1,200 clinical records from the MIETIC corpus (v1.0.0; 5,528 unique cases after deduplication), relabeled from the Emergency Severity Index to CTM by four board-certified emergency physicians (400 cases per category), with physician consensus as the reference standard. Primary outcomes were overall accuracy and Cohen kappa; secondary outcomes included per-class sensitivity, specificity, positive and negative predictive value with 95% Wilson-score confidence intervals, undertriage detection rate, and API cost. Accuracy ranged from 66.5% to 68.1% (kappa 0.50–0.52). DeepSeek V4 Flash achieved the highest accuracy (68.1%, 95% CI 65.4–70.7%) at $0.207 total cost. No pairwise McNemar comparison was statistically significant (p > 0.05). All models exceeded benchmarks previously reported for ChatGPT on the Canadian Triage and Acuity Scale, while kappa values were comparable to GPT-4 on the Korean Triage and Acuity Scale. Undertriage detection varied markedly: MiMo V2.5 identified 56.6% of undertriaged cases versus 11.9% for DeepSeek V4 Pro. Lower-cost models performed equivalently to more expensive alternatives, though undertriage detection remained suboptimal across all models. These findings support the potential role of LLMs as adjunctive decision aids in resource-limited EDs, pending prospective validation in authentic clinical settings.

Zitieren

APA

Fauzi, A. R., Sazkia, A. C., & Ardiansyah, M. (2026). Diagnostic Accuracy of Four Large Language Models for the Cipto Triage Method: A Comparative Evaluation for Emergency Department Triage in Resource-Limited Settings. Journal of Electronics, Electromedical Engineering, and Medical Informatics, 8(4), 1735-1752. https://doi.org/10.35882/jeeemi.v8i4.2022

Vancouver

Fauzi AR, Sazkia AC, Ardiansyah M. Diagnostic Accuracy of Four Large Language Models for the Cipto Triage Method: A Comparative Evaluation for Emergency Department Triage in Resource-Limited Settings. Journal of Electronics, Electromedical Engineering, and Medical Informatics. 2026;8(4):1735-1752. doi:10.35882/jeeemi.v8i4.2022

BibTeX
@article{Fauzi2026,
  author = {Fauzi, Ahmad Ridwan and Sazkia, Adelia Chitra and Ardiansyah, Muhammad},
  title = {Diagnostic Accuracy of Four Large Language Models for the Cipto Triage Method: A Comparative Evaluation for Emergency Department Triage in Resource-Limited Settings},
  journal = {Journal of Electronics, Electromedical Engineering, and Medical Informatics},
  year = {2026},
  volume = {8},
  number = {4},
  pages = {1735--1752},
  doi = {10.35882/jeeemi.v8i4.2022}
}
Kostenlos starten →