GPT-3.5 Turbo and GPT-4 Turbo in Title and Abstract Screening for Systematic Reviews
JMIR Medical Informatics · 2025-03-12 · 13 · e64682-e64682
DOI: 10.2196/64682 ↗At a glance
Journal article in JMIR Medical Informatics, published online on 2025-03-12. Written by Takehiko Oami and 2 co-authors. Institution: Department of Emergency and Critical Care Medicine, Chiba University Graduate School of Medicine, 1-8-1 Inohana, Chuo, Chiba, 260-8677, Japan, 81 432…. Major MEDLINE topics: Review Literature as Topic, Systematic Reviews as Topic. Cited 17 times so far (Crossref); 10 references. The full text is freely available in PubMed Central.
Abstract (original language)
This study demonstrated that while GPT-4 Turbo had superior specificity when compared to GPT-3.5 Turbo (0.98 vs 0.51), as well as comparable sensitivity (0.85 vs 0.83), GPT-3.5 Turbo processed 100 studies faster (0.9 min vs 1.6 min) in citation screening for systematic reviews, suggesting that GPT-4 Turbo may be more suitable due to its higher specificity and highlighting the potential of large language models in optimizing literature selection.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Department of Emergency and Critical Care Medicine, Chiba University Graduate School of Medicine, 1-8-1 Inohana, Chuo, Chiba, 260-8677, Japan, 81 432262372.
- Department of Preventive Services, Kyoto University Graduate School of Medicine, Kyoto, Japan.
- Health Services and Systems Research, Duke-NUS Medical School, National University of Singapore, Singapore, Singapore.
ORCID profiles: Takehiko Oami, Yohei Okada, Taka-Aki Nakada
Cite
APA
Oami, T., Okada, Y., & Nakada, T. A. (2025). GPT-3.5 Turbo and GPT-4 Turbo in Title and Abstract Screening for Systematic Reviews. JMIR Medical Informatics, 13, e64682-e64682. https://doi.org/10.2196/64682
Vancouver
Oami T, Okada Y, Nakada TA. GPT-3.5 Turbo and GPT-4 Turbo in Title and Abstract Screening for Systematic Reviews. JMIR Medical Informatics. 2025;13:e64682-e64682. doi:10.2196/64682
BibTeX
@article{Oami2025,
author = {Oami, Takehiko and Okada, Yohei and Nakada, Taka-Aki},
title = {GPT-3.5 Turbo and GPT-4 Turbo in Title and Abstract Screening for Systematic Reviews},
journal = {JMIR Medical Informatics},
year = {2025},
volume = {13},
pages = {e64682--e64682},
doi = {10.2196/64682}
}
EUVIMED