EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The Role of Large Language Models (LLMs) in Providing Triage for Maxillofacial Trauma Cases: A Preliminary Study

Andrea Frosolini iD, Lisa Catarzi iD, Simone Benedetti iD, Linda Latini iD, Glauco Chisci iD, Leonardo Franz iD, Paolo Gennaro, Guido Gabriele

Diagnostics · 18.04.2024 · 14 (8) · 839

DOI: 10.3390/diagnostics14080839 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Diagnostics, online erschienen am 18.04.2024. Verfasst von Andrea Frosolini und 7 weiteren Autor:innen. Beteiligte Einrichtung: Maxillofacial Surgery Unit, Department of Medical Biotechnologies, University of Siena, 53100 Siena, Italy. Die Arbeit wurde bisher 42-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University of Siena golden access.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

In the evolving field of maxillofacial surgery, integrating advanced technologies like Large Language Models (LLMs) into medical practices, especially for trauma triage, presents a promising yet largely unexplored potential. This study aimed to evaluate the feasibility of using LLMs for triaging complex maxillofacial trauma cases by comparing their performance against the expertise of a tertiary referral center.

Methods

Utilizing a comprehensive review of patient records in a tertiary referral center over a year-long period, standardized prompts detailing patient demographics, injury characteristics, and medical histories were created. These prompts were used to assess the triage suggestions of ChatGPT 4.0 and Google GEMINI against the center’s recommendations, supplemented by evaluating the AI’s performance using the QAMAI and AIPI questionnaires.

Results

The results in 10 cases of major maxillofacial trauma indicated moderate agreement rates between LLM recommendations and the referral center, with some variances in the suggestion of appropriate examinations (70% ChatGPT and 50% GEMINI) and treatment plans (60% ChatGPT and 45% GEMINI). Notably, the study found no statistically significant differences in several areas of the questionnaires, except in the diagnosis accuracy (GEMINI: 3.30, ChatGPT: 2.30; p = 0.032) and relevance of the recommendations (GEMINI: 2.90, ChatGPT: 3.50; p = 0.021). A Spearman correlation analysis highlighted significant correlations within the two questionnaires, specifically between the QAMAI total score and AIPI treatment scores (rho = 0.767, p = 0.010).

Conclusions

This exploratory investigation underscores the potential of LLMs in enhancing clinical decision making for maxillofacial trauma cases, indicating a need for further research to refine their application in healthcare settings.

Schlagwörter

Stichwörter der Autor:innen

AIPIChatGPTGEMINILarge Language Models (LLM)QAMAImaxillofacialmaxillofacial surgerytraumatriage

Autor:innen und Institutionen

  • Maxillofacial Surgery Unit, Department of Medical Biotechnologies, University of Siena, 53100 Siena, Italy.
  • Phoniatris and Audiology Unit, Department of Neuroscience DNS, University of Padova, 35122 Treviso, Italy.
  • Artificial Intelligence in Medicine and Innovation in Clinical Research and Methodology (PhD Program), Department of Clinical and Experimental Sciences, University of Brescia, 25121 Brescia, Italy.

ORCID-Profile: Andrea Frosolini, Lisa Catarzi, Simone Benedetti, Linda Latini, Glauco Chisci, Leonardo Franz

Förderung

  • University of Siena golden access

Zitieren

APA

Frosolini, A., Catarzi, L., Benedetti, S., Latini, L., Chisci, G., Franz, L., Gennaro, P., & Gabriele, G. (2024). The Role of Large Language Models (LLMs) in Providing Triage for Maxillofacial Trauma Cases: A Preliminary Study. Diagnostics, 14(8), 839. https://doi.org/10.3390/diagnostics14080839

Vancouver

Frosolini A, Catarzi L, Benedetti S, Latini L, Chisci G, Franz L, et al. The Role of Large Language Models (LLMs) in Providing Triage for Maxillofacial Trauma Cases: A Preliminary Study. Diagnostics. 2024;14(8):839. doi:10.3390/diagnostics14080839

BibTeX
@article{Frosolini2024,
  author = {Frosolini, Andrea and Catarzi, Lisa and Benedetti, Simone and Latini, Linda and Chisci, Glauco and Franz, Leonardo and Gennaro, Paolo and Gabriele, Guido},
  title = {The Role of Large Language Models (LLMs) in Providing Triage for Maxillofacial Trauma Cases: A Preliminary Study},
  journal = {Diagnostics},
  year = {2024},
  volume = {14},
  number = {8},
  pages = {839},
  doi = {10.3390/diagnostics14080839}
}
Kostenlos starten →