ARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE SARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE STUDY OF NLP, LLM, AND JEPA ARCHITECTURES (Preprint)
JMIR Medical Informatics · 2025
DOI: 10.2196/83318 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift JMIR Medical Informatics, 2025. Verfasst von Edouard Lansiaux und 4 weiteren Autor:innen. Beteiligte Einrichtung: Emergency Department, Lille University Hospital, Lille, France. Hauptthemen laut MEDLINE: Triage, Emergency Service, Hospital, Natural Language Processing, Artificial Intelligence. Die Arbeit nennt 10 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
BACKGROUND: Triage errors in emergency departments (EDs), including undertriage and overtriage, pose significant risks to patient safety and resource allocation. With increasing patient volumes and staffing challenges, artificial intelligence (AI) integration into triage protocols has gained attention as a potential solution. OBJECTIVE: This study aims to develop and compare 3 AI models-natural language processing (NLP), large language model (LLM), and Joint Embedding Predictive Architecture (JEPA)-for predicting triage outcomes according to the French Emergency Nurses Classification in Hospital (FRENCH) scale and to assess their performance relative to nurse triage and clinical expert consensus. METHODS: We conducted a retrospective analysis of prospectively collected data from adult patients triaged at Roger Salengro Hospital ED (Lille, France) over 7 months (June-December 2024). Three AI models were developed: TRIAGEMASTER (NLP with Doc2Vec + MLP), URGENTIAPARSE (LLM with FlauBERT + Extreme Gradient Boosting [XGBoost]), and EMERGINET (JEPA with variance-invariance-covariance regularization). Of 73,236 ED visits, 657 (0.90%) had complete audio recordings and structured data. Data were split 80:20 into training and validation sets with stratification. Gold-standard labels were established by senior clinician consensus (minimum 5 years of ED experience). The primary outcome was concordance with the gold-standard FRENCH triage level, assessed using weighted κ, Spearman correlation, F1-score, area under the receiver operating characteristic (AUC-ROC) curve, mean absolute error (MAE), and root mean square error (RMSE). Secondary analyses evaluated Groupes d'Etude Multicentrique des Services d'Accueil (GEMSA) prediction and performance by input data type. RESULTS: URGENTIAPARSE demonstrated superior performance, with a composite z score of 2.514 compared with EMERGINET (0.438), TRIAGEMASTER (-3.511), and nurse triage (-4.343). URGENTIAPARSE achieved an F1-score of 0.900 (95% CI 0.876-0.924), an AUC-ROC of 0.879 (95% CI 0.851-0.907), a weighted κ of 0.800 (P
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Emergency Department, Lille University Hospital, Lille, France.
- Centre Antipoison, Lille University Hospital, Lille, France.
- ULR 2694-METRICS, Lille University, Lille, France.
- Department of Public Health, EA 2694, Lille University, Lille, France.
- Emergency Department, Hôpital Pitié-Salpêtrière, Assistance Publique des Hôpitaux de Paris, Paris, France.
ORCID-Profile: Edouard Lansiaux, Ramy Azzouz, Emmanuel Chazard, Amélie Vromant, Eric Wiel
Zitieren
APA
Lansiaux, E., Azzouz, R., Chazard, E., Vromant, A., & Wiel, E. (2025). ARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE SARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE STUDY OF NLP, LLM, AND JEPA ARCHITECTURES (Preprint). JMIR Medical Informatics. https://doi.org/10.2196/83318
Vancouver
Lansiaux E, Azzouz R, Chazard E, Vromant A, Wiel E. ARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE SARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE STUDY OF NLP, LLM, AND JEPA ARCHITECTURES (Preprint). JMIR Medical Informatics. 2025. doi:10.2196/83318
BibTeX
@article{Lansiaux2025,
author = {Lansiaux, Edouard and Azzouz, Ramy and Chazard, Emmanuel and Vromant, Amélie and Wiel, Eric},
title = {ARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE SARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE STUDY OF NLP, LLM, AND JEPA ARCHITECTURES (Preprint)},
journal = {JMIR Medical Informatics},
year = {2025},
doi = {10.2196/83318}
}
EUVIMED