EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Utilization of Large Language Models in Prehospital Triage: A Focus on ChatGPT’s Performance According to Pre-KTAS

Ki-Ung Kan, Byungwoo Kim

Fire Science and Engineering · 31.10.2026 · 40 (5) · 107-117

DOI: 10.7731/kifse.f0338352 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Fire Science and Engineering, erschienen am 31.10.2026. Verfasst von Ki-Ung Kan und 1 weiteren Autor:innen. Die Arbeit nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study evaluated the applicability of a large language model (LLM) as a decision-support tool for prehospital triage based on the Prehospital Korean Triage and Acuity Scale (Pre-KTAS). A simulation-based comparative study used 100 Pre-KTAS scenarios to compare two system groups, a non-trained LLM and a trained LLM (an LLM provided with Pre-KTAS educational materials), with a control group of 10 active-duty 119 paramedics. Each LLM evaluated all 100 scenarios in 30 independent repetitions. The outcomes included accuracy, classification consistency, agreement with paramedics, over- and under-triage patterns, sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and area under the receiver operating characteristic curve (AUC). Data were analyzed using Welch’s analysis of variance, Games-Howell post hoc tests, intraclass correlation coefficients (ICC), kappa statistics, chi-square tests, and receiver operating characteristic analysis. Overall accuracy was 0.69 ± 0.10 for the non-trained LLM, 0.81 ± 0.03 for the trained LLM, and 0.80 ± 0.03 for paramedics. The trained LLM and paramedics were significantly more accurate than the non-trained LLM (p < .001), with no significant difference between them. The trained LLM showed the highest classification consistency (ICC (3,1) = 0.940), the lowest under-triage rate (6.1%), and the highest sensitivity (0.95) and NPV (0.97). Paramedics showed the highest specificity (0.96) and PPV (0.93). The AUC values were 0.915 for the non-trained LLM and 0.934 for both the trained LLM and paramedics. These findings suggest that a Pre-KTAS-trained LLM may support prehospital triage decisions, although field validation and institutional and ethical guidance are required before clinical use.

Zitieren

APA

Kan, K., & Kim, B. (2026). Utilization of Large Language Models in Prehospital Triage: A Focus on ChatGPT’s Performance According to Pre-KTAS. Fire Science and Engineering, 40(5), 107-117. https://doi.org/10.7731/kifse.f0338352

Vancouver

Kan K, Kim B. Utilization of Large Language Models in Prehospital Triage: A Focus on ChatGPT’s Performance According to Pre-KTAS. Fire Science and Engineering. 2026;40(5):107-117. doi:10.7731/kifse.f0338352

BibTeX
@article{Kan2026,
  author = {Kan, Ki-Ung and Kim, Byungwoo},
  title = {Utilization of Large Language Models in Prehospital Triage: A Focus on ChatGPT’s Performance According to Pre-KTAS},
  journal = {Fire Science and Engineering},
  year = {2026},
  volume = {40},
  number = {5},
  pages = {107--117},
  doi = {10.7731/kifse.f0338352}
}
Kostenlos starten →