EUVIMEDOpdag EUVIMED
VergleichsstudieOpen access

ARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE SARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE STUDY OF NLP, LLM, AND JEPA ARCHITECTURES (Preprint)

Edouard Lansiaux iD, Ramy Azzouz iD, Emmanuel Chazard iD, Amélie Vromant iD, Eric Wiel iD

JMIR Medical Informatics · 2025

DOI: 10.2196/83318 ↗

At a glance

Vergleichsstudie in JMIR Medical Informatics, 2025. Written by Edouard Lansiaux and 4 co-authors. Institution: Emergency Department, Lille University Hospital, Lille, France. Major MEDLINE topics: Triage, Emergency Service, Hospital, Natural Language Processing, Artificial Intelligence. 10 references. The full text is freely available in PubMed Central.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

BACKGROUND: Triage errors in emergency departments (EDs), including undertriage and overtriage, pose significant risks to patient safety and resource allocation. With increasing patient volumes and staffing challenges, artificial intelligence (AI) integration into triage protocols has gained attention as a potential solution. OBJECTIVE: This study aims to develop and compare 3 AI models-natural language processing (NLP), large language model (LLM), and Joint Embedding Predictive Architecture (JEPA)-for predicting triage outcomes according to the French Emergency Nurses Classification in Hospital (FRENCH) scale and to assess their performance relative to nurse triage and clinical expert consensus. METHODS: We conducted a retrospective analysis of prospectively collected data from adult patients triaged at Roger Salengro Hospital ED (Lille, France) over 7 months (June-December 2024). Three AI models were developed: TRIAGEMASTER (NLP with Doc2Vec + MLP), URGENTIAPARSE (LLM with FlauBERT + Extreme Gradient Boosting [XGBoost]), and EMERGINET (JEPA with variance-invariance-covariance regularization). Of 73,236 ED visits, 657 (0.90%) had complete audio recordings and structured data. Data were split 80:20 into training and validation sets with stratification. Gold-standard labels were established by senior clinician consensus (minimum 5 years of ED experience). The primary outcome was concordance with the gold-standard FRENCH triage level, assessed using weighted κ, Spearman correlation, F1-score, area under the receiver operating characteristic (AUC-ROC) curve, mean absolute error (MAE), and root mean square error (RMSE). Secondary analyses evaluated Groupes d'Etude Multicentrique des Services d'Accueil (GEMSA) prediction and performance by input data type. RESULTS: URGENTIAPARSE demonstrated superior performance, with a composite z score of 2.514 compared with EMERGINET (0.438), TRIAGEMASTER (-3.511), and nurse triage (-4.343). URGENTIAPARSE achieved an F1-score of 0.900 (95% CI 0.876-0.924), an AUC-ROC of 0.879 (95% CI 0.851-0.907), a weighted κ of 0.800 (P

Subjects

MeSH terms (MEDLINE)

TriageEmergency Service, HospitalNatural Language ProcessingArtificial IntelligenceRetrospective StudiesHumansLarge Language ModelsFranceFemaleMaleAdultMiddle AgedROC Curve

Author keywords

FRENCH scaleJoint Embedding Predictive Architectureartificial intelligenceclinical decision supportemergency departmentlarge language modelnatural language processingtriage

Authors and institutions

  • Emergency Department, Lille University Hospital, Lille, France.
  • Centre Antipoison, Lille University Hospital, Lille, France.
  • ULR 2694-METRICS, Lille University, Lille, France.
  • Department of Public Health, EA 2694, Lille University, Lille, France.
  • Emergency Department, Hôpital Pitié-Salpêtrière, Assistance Publique des Hôpitaux de Paris, Paris, France.

ORCID profiles: Edouard Lansiaux, Ramy Azzouz, Emmanuel Chazard, Amélie Vromant, Eric Wiel

Cite

APA

Lansiaux, E., Azzouz, R., Chazard, E., Vromant, A., & Wiel, E. (2025). ARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE SARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE STUDY OF NLP, LLM, AND JEPA ARCHITECTURES (Preprint). JMIR Medical Informatics. https://doi.org/10.2196/83318

Vancouver

Lansiaux E, Azzouz R, Chazard E, Vromant A, Wiel E. ARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE SARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE STUDY OF NLP, LLM, AND JEPA ARCHITECTURES (Preprint). JMIR Medical Informatics. 2025. doi:10.2196/83318

BibTeX
@article{Lansiaux2025,
  author = {Lansiaux, Edouard and Azzouz, Ramy and Chazard, Emmanuel and Vromant, Amélie and Wiel, Eric},
  title = {ARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE SARTIFICIAL INTELLIGENCE MODELS FOR PREDICTING TRIAGE IN EMERGENCY DEPARTMENTS: A 7-MONTH RETROSPECTIVE COMPARATIVE STUDY OF NLP, LLM, AND JEPA ARCHITECTURES (Preprint)},
  journal = {JMIR Medical Informatics},
  year = {2025},
  doi = {10.2196/83318}
}
Start for free →