Importance of Patient History in Artificial Intelligence–Assisted Medical Diagnosis: Comparison Study
JMIR Medical Education · 2024
DOI: 10.2196/52674 ↗At a glance
Journal article in JMIR Medical Education, 2024. Written by Fumitoshi Fukuzawa and 10 co-authors. Institution: Department of General Medicine, Chiba University Hospital, Chiba-shi, Japan. Major MEDLINE topics: Artificial Intelligence, Medicine. Cited 30 times so far (Crossref); 34 references. The full text is freely available in PubMed Central.
Abstract (original language)
Background
Medical history contributes approximately 80% to a diagnosis, although physical examinations and laboratory investigations increase a physician’s confidence in the medical diagnosis. The concept of artificial intelligence (AI) was first proposed more than 70 years ago. Recently, its role in various fields of medicine has grown remarkably. However, no studies have evaluated the importance of patient history in AI-assisted medical diagnosis.
Objective
This study explored the contribution of patient history to AI-assisted medical diagnoses and assessed the accuracy of ChatGPT in reaching a clinical diagnosis based on the medical history provided.
Methods
Using clinical vignettes of 30 cases identified in The BMJ , we evaluated the accuracy of diagnoses generated by ChatGPT. We compared the diagnoses made by ChatGPT based solely on medical history with the correct diagnoses. We also compared the diagnoses made by ChatGPT after incorporating additional physical examination findings and laboratory data alongside history with the correct diagnoses.
Results
ChatGPT accurately diagnosed 76.6% (23/30) of the cases with only the medical history, consistent with previous research targeting physicians. We also found that this rate was 93.3% (28/30) when additional information was included.
Conclusions
Although adding additional information improves diagnostic accuracy, patient history remains a significant factor in AI-assisted medical diagnosis. Thus, when using AI in medical diagnosis, it is crucial to include pertinent and correct patient histories for an accurate diagnosis. Our findings emphasize the continued significance of patient history in clinical diagnoses in this age and highlight the need for its integration into AI-assisted medical diagnosis systems.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Department of General Medicine, Chiba University Hospital, Chiba-shi, Japan.
- Uchida Internal Medicine Clinic, Saitama-shi, Japan.
ORCID profiles: Fumitoshi Fukuzawa, Yasutaka Yanagita, Daiki Yokokawa, Shun Uchida, Shiho Yamashita, Yu Li, Kiyoshi Shikino, Tomoko Tsukamoto, Kazutaka Noda, Takanori Uehara, Masatomi Ikusaka
Cite
APA
Fukuzawa, F., Yanagita, Y., Yokokawa, D., Uchida, S., Yamashita, S., Li, Y., Shikino, K., Tsukamoto, T., Noda, K., Uehara, T., & Ikusaka, M. (2024). Importance of Patient History in Artificial Intelligence–Assisted Medical Diagnosis: Comparison Study. JMIR Medical Education. https://doi.org/10.2196/52674
Vancouver
Fukuzawa F, Yanagita Y, Yokokawa D, Uchida S, Yamashita S, Li Y, et al. Importance of Patient History in Artificial Intelligence–Assisted Medical Diagnosis: Comparison Study. JMIR Medical Education. 2024. doi:10.2196/52674
BibTeX
@article{Fukuzawa2024,
author = {Fukuzawa, Fumitoshi and Yanagita, Yasutaka and Yokokawa, Daiki and Uchida, Shun and Yamashita, Shiho and Li, Yu and Shikino, Kiyoshi and Tsukamoto, Tomoko and Noda, Kazutaka and Uehara, Takanori and Ikusaka, Masatomi},
title = {Importance of Patient History in Artificial Intelligence–Assisted Medical Diagnosis: Comparison Study},
journal = {JMIR Medical Education},
year = {2024},
doi = {10.2196/52674}
}
EUVIMED