ARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE SARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE STUDY OF NLP, LLM, AND JEPA ARCHITECTURES (Preprint)
JMIR Medical Informatics · 2025
DOI: 10.2196/83318 ↗At a glance
Vergleichsstudie in JMIR Medical Informatics, 2025. Written by Edouard Lansiaux and 4 co-authors. Institution: Emergency Department, Lille University Hospital, Lille, France. Major MEDLINE topics: Triage, Emergency Service, Hospital, Natural Language Processing, Artificial Intelligence. 10 references. The full text is freely available in PubMed Central.
Abstract (original language)
BACKGROUND: Triage errors in emergency departments (EDs), including undertriage and overtriage, pose significant risks to patient safety and resource allocation. With increasing patient volumes and staffing challenges, artificial intelligence (AI) integration into triage protocols has gained attention as a potential solution. OBJECTIVE: This study aims to develop and compare 3 AI models-natural language processing (NLP), large language model (LLM), and Joint Embedding Predictive Architecture (JEPA)-for predicting triage outcomes according to the French Emergency Nurses Classification in Hospital (FRENCH) scale and to assess their performance relative to nurse triage and clinical expert consensus. METHODS: We conducted a retrospective analysis of prospectively collected data from adult patients triaged at Roger Salengro Hospital ED (Lille, France) over 7 months (June-December 2024). Three AI models were developed: TRIAGEMASTER (NLP with Doc2Vec + MLP), URGENTIAPARSE (LLM with FlauBERT + Extreme Gradient Boosting [XGBoost]), and EMERGINET (JEPA with variance-invariance-covariance regularization). Of 73,236 ED visits, 657 (0.90%) had complete audio recordings and structured data. Data were split 80:20 into training and validation sets with stratification. Gold-standard labels were established by senior clinician consensus (minimum 5 years of ED experience). The primary outcome was concordance with the gold-standard FRENCH triage level, assessed using weighted κ, Spearman correlation, F1-score, area under the receiver operating characteristic (AUC-ROC) curve, mean absolute error (MAE), and root mean square error (RMSE). Secondary analyses evaluated Groupes d'Etude Multicentrique des Services d'Accueil (GEMSA) prediction and performance by input data type. RESULTS: URGENTIAPARSE demonstrated superior performance, with a composite z score of 2.514 compared with EMERGINET (0.438), TRIAGEMASTER (-3.511), and nurse triage (-4.343). URGENTIAPARSE achieved an F1-score of 0.900 (95% CI 0.876-0.924), an AUC-ROC of 0.879 (95% CI 0.851-0.907), a weighted κ of 0.800 (P
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Emergency Department, Lille University Hospital, Lille, France.
- Centre Antipoison, Lille University Hospital, Lille, France.
- ULR 2694-METRICS, Lille University, Lille, France.
- Department of Public Health, EA 2694, Lille University, Lille, France.
- Emergency Department, Hôpital Pitié-Salpêtrière, Assistance Publique des Hôpitaux de Paris, Paris, France.
ORCID profiles: Edouard Lansiaux, Ramy Azzouz, Emmanuel Chazard, Amélie Vromant, Eric Wiel
Cite
APA
Lansiaux, E., Azzouz, R., Chazard, E., Vromant, A., & Wiel, E. (2025). ARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE SARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE STUDY OF NLP, LLM, AND JEPA ARCHITECTURES (Preprint). JMIR Medical Informatics. https://doi.org/10.2196/83318
Vancouver
Lansiaux E, Azzouz R, Chazard E, Vromant A, Wiel E. ARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE SARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE STUDY OF NLP, LLM, AND JEPA ARCHITECTURES (Preprint). JMIR Medical Informatics. 2025. doi:10.2196/83318
BibTeX
@article{Lansiaux2025,
author = {Lansiaux, Edouard and Azzouz, Ramy and Chazard, Emmanuel and Vromant, Amélie and Wiel, Eric},
title = {ARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE SARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE STUDY OF NLP, LLM, AND JEPA ARCHITECTURES (Preprint)},
journal = {JMIR Medical Informatics},
year = {2025},
doi = {10.2196/83318}
}
EUVIMED