GPT-4 in Clinical Practice: Assessing Its Capability for Symptom Extraction from Cancer Patient Notes
Studies in Health Technology and Informatics · 2025
DOI: 10.3233/shti250054 ↗Kurz gefasst
Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, 2025. Verfasst von Fatemeh Shah-Mohammadi und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Informatics, School of Medicine, University of Utah, USA. Hauptthemen laut MEDLINE: Neoplasms, Electronic Health Records, Data Mining, Natural Language Processing. Die Arbeit wurde bisher 4-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: NHLBI NIH HHS.
Abstract (Originalsprache)
Accurate extraction of patient symptoms and signs from clinical notes is essential for effective diagnosis, treatment planning, and research. In this study, we evaluate the capability of GPT-4, specifically GPT-4o, in extracting symptoms and signs from nursing notes within the MIMIC-III dataset. We experimented with two temperature settings (1 and 0.3) to explore the impact of model diversity and consistency on extraction accuracy. Performance metrics include precision, specificity, recall, and F1-score. The results show that a higher temperature (1) led to more creative and varied outputs, with a mean precision of 79% and specificity of 96%, but also exhibited variability, with a minimum precision of 24%. Conversely, at a lower temperature (0.3), precision was more conservative but dropped significantly, with a mean precision of 45% and minimum of 0%. High recall and specificity at optimal temperature setting indicates that GPT-4 holds promise as an assistive tool in clinical practice for symptom and sign extraction tasks.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Biomedical Informatics, School of Medicine, University of Utah, USA.
Förderung
- NHLBI NIH HHS
Zitieren
APA
Shah-Mohammadi, F., & Finkelstein, J. (2025). GPT-4 in Clinical Practice: Assessing Its Capability for Symptom Extraction from Cancer Patient Notes. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti250054
Vancouver
Shah-Mohammadi F, Finkelstein J. GPT-4 in Clinical Practice: Assessing Its Capability for Symptom Extraction from Cancer Patient Notes. Studies in Health Technology and Informatics. 2025. doi:10.3233/shti250054
BibTeX
@article{ShahMohammadi2025,
author = {Shah-Mohammadi, Fatemeh and Finkelstein, Joseph},
title = {GPT-4 in Clinical Practice: Assessing Its Capability for Symptom Extraction from Cancer Patient Notes},
journal = {Studies in Health Technology and Informatics},
year = {2025},
doi = {10.3233/shti250054}
}
EUVIMED