Clinical Reasoning and Knowledge Assessment of Rheumatology Residents Compared to AI Models: A Pilot Study
Journal of Clinical Medicine · 05.12.2024 · 13 (23) · 7405
DOI: 10.3390/jcm13237405 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Clinical Medicine, online erschienen am 05.12.2024. Verfasst von Esra Kayacan Erdoğan und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Rheumatology, Division of Internal Medicine, Ankara Bilkent City Hospital, Ankara 06800, Turkey. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
The integration of artificial intelligence (AI) in medicine has progressed from rule-based systems to advanced models and is showing potential in clinical decision-making. In this study, the psychological impact of AI collaboration in clinical practice is assessed, highlighting its role as a support tool for medical residents. This study aimed to compare clinical decision-making approaches of junior rheumatology residents with both trained and untrained AI models in clinical reasoning, pre-diagnosis, first-line, and second-line management stages.
Methods
Ten junior rheumatology residents and two GPT-4 models (trained and untrained) responded to 10 clinical cases, encompassing diagnostic and treatment challenges in inflammatory arthritis. The cases were evaluated using the Revised-IDEA (R-IDEA) scoring system and additional case management metrics. In addition to scoring clinical case performance, residents’ attitudes toward AI integration in clinical practice were assessed through a structured questionnaire, focusing on perceptions of AI’s potential after reviewing the trained GPT-4’s answers.
Results
Trained GPT-4 outperformed residents across all stages, achieving significantly higher median R-IDEA scores and superior performance in pre-diagnosis, first-line, and second-line management phases. Residents expressed a positive attitude toward AI integration, with 60% favoring AI as a supportive tool in clinical practice, anticipating benefits in competence, fatigue, and burnout.
Conclusions
Trained GPT-4 models outperform junior residents in clinical reasoning and management of rheumatology cases. Residents’ positive attitudes toward AI suggest its potential as a supportive tool to enhance confidence and reduce uncertainty in clinical practice. Trained GPT-4 may be used as a supplementary tool during the early years of residency.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Rheumatology, Division of Internal Medicine, Ankara Bilkent City Hospital, Ankara 06800, Turkey.
ORCID-Profile: Esra Kayacan Erdoğan, Hakan Babaoğlu
Zitieren
APA
Kayacan Erdoğan, E., & Babaoğlu, H. (2024). Clinical Reasoning and Knowledge Assessment of Rheumatology Residents Compared to AI Models: A Pilot Study. Journal of Clinical Medicine, 13(23), 7405. https://doi.org/10.3390/jcm13237405
Vancouver
Kayacan Erdoğan E, Babaoğlu H. Clinical Reasoning and Knowledge Assessment of Rheumatology Residents Compared to AI Models: A Pilot Study. Journal of Clinical Medicine. 2024;13(23):7405. doi:10.3390/jcm13237405
BibTeX
@article{KayacanErdoan2024,
author = {Kayacan Erdoğan, Esra and Babaoğlu, Hakan},
title = {Clinical Reasoning and Knowledge Assessment of Rheumatology Residents Compared to AI Models: A Pilot Study},
journal = {Journal of Clinical Medicine},
year = {2024},
volume = {13},
number = {23},
pages = {7405},
doi = {10.3390/jcm13237405}
}
EUVIMED