ChatGPT as a teaching tool: Preparing pathology residents for board examination with AI-generated digestive system pathology tests
American Journal of Clinical Pathology · 04.11.2024 · 162 (5) · 471-479
DOI: 10.1093/ajcp/aqae062 ↗Kurz gefasst
Fachartikel in der Zeitschrift American Journal of Clinical Pathology, online erschienen am 25.05.2024. Verfasst von Thiyaphat Laohawetwanit und 2 weiteren Autor:innen. Beteiligte Einrichtung: Division of Pathology, Chulabhorn International College of Medicine, Thammasat University, Pathum Thani, Thailand. Hauptthemen laut MEDLINE: Internship and Residency, Educational Measurement. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 26 Literaturangaben.
Abstract (Originalsprache)
Objectives
To evaluate the effectiveness of ChatGPT 4 in generating multiple-choice questions (MCQs) with explanations for pathology board examinations, specifically for digestive system pathology.
Methods
The customized ChatGPT 4 model was developed for MCQ and explanation generation. Expert pathologists evaluated content accuracy and relevance. These MCQs were then administered to pathology residents, followed by an analysis focusing on question difficulty, accuracy, item discrimination, and internal consistency.
Results
The customized ChatGPT 4 generated 80 MCQs covering various gastrointestinal and hepatobiliary topics. While the MCQs demonstrated moderate to high agreement in evaluation parameters such as content accuracy, clinical relevance, and overall quality, there were issues in cognitive level and distractor quality. The explanations were generally acceptable. Involving 9 residents with a median experience of 1 year, the average score was 57.4 (71.8%). Pairwise comparisons revealed a significant difference in performance between each year group (P < .01). The test analysis showed moderate difficulty, effective item discrimination (index = 0.15), and good internal consistency (Cronbach’s α = 0.74).
Conclusions
ChatGPT 4 demonstrated significant potential as a supplementary educational tool in medical education, especially in generating MCQs with explanations similar to those seen in board examinations. While artificial intelligence–generated content was of high quality, it necessitated refinement and expert review.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Division of Pathology, Chulabhorn International College of Medicine, Thammasat University, Pathum Thani, Thailand.
- Division of Pathology, Thammasat University Hospital, Pathum Thani, Thailand.
ORCID-Profile: Thiyaphat Laohawetwanit, Sompon Apornvirat, Charinee Kantasiripitak
Zitieren
APA
Laohawetwanit, T., Apornvirat, S., & Kantasiripitak, C. (2024). ChatGPT as a teaching tool: Preparing pathology residents for board examination with AI-generated digestive system pathology tests. American Journal of Clinical Pathology, 162(5), 471-479. https://doi.org/10.1093/ajcp/aqae062
Vancouver
Laohawetwanit T, Apornvirat S, Kantasiripitak C. ChatGPT as a teaching tool: Preparing pathology residents for board examination with AI-generated digestive system pathology tests. American Journal of Clinical Pathology. 2024;162(5):471-479. doi:10.1093/ajcp/aqae062
BibTeX
@article{Laohawetwanit2024,
author = {Laohawetwanit, Thiyaphat and Apornvirat, Sompon and Kantasiripitak, Charinee},
title = {ChatGPT as a teaching tool: Preparing pathology residents for board examination with AI-generated digestive system pathology tests},
journal = {American Journal of Clinical Pathology},
year = {2024},
volume = {162},
number = {5},
pages = {471--479},
doi = {10.1093/ajcp/aqae062}
}
EUVIMED