EUVIMEDAtrasti EUVIMED
Open access

GPT-3.5 Turbo and GPT-4 Turbo in Title and Abstract Screening for Systematic Reviews

Takehiko Oami iD, Yohei Okada iD, Taka-Aki Nakada iD

JMIR Medical Informatics · 2025-03-12 · 13 · e64682-e64682

DOI: 10.2196/64682 ↗

At a glance

Journal article in JMIR Medical Informatics, published online on 2025-03-12. Written by Takehiko Oami and 2 co-authors. Institution: Department of Emergency and Critical Care Medicine, Chiba University Graduate School of Medicine, 1-8-1 Inohana, Chuo, Chiba, 260-8677, Japan, 81 432…. Major MEDLINE topics: Review Literature as Topic, Systematic Reviews as Topic. Cited 17 times so far (Crossref); 10 references. The full text is freely available in PubMed Central.

SantraukaSubjectsBibliografiniai duomenysCiteRelated studies

Abstract (original language)

This study demonstrated that while GPT-4 Turbo had superior specificity when compared to GPT-3.5 Turbo (0.98 vs 0.51), as well as comparable sensitivity (0.85 vs 0.83), GPT-3.5 Turbo processed 100 studies faster (0.9 min vs 1.6 min) in citation screening for systematic reviews, suggesting that GPT-4 Turbo may be more suitable due to its higher specificity and highlighting the potential of large language models in optimizing literature selection.

Subjects

MeSH terms (MEDLINE)

Review Literature as TopicSystematic Reviews as TopicHumansAbstracting and IndexingGenerative Artificial Intelligence

Author keywords

AIGPTJapanJapaneseLLMaccuracyartificial intelligencecitation screeningcitationsclinical practice guidelinescritical careefficiencylarge language modelsreliabilityreview

Authors and institutions

  • Department of Emergency and Critical Care Medicine, Chiba University Graduate School of Medicine, 1-8-1 Inohana, Chuo, Chiba, 260-8677, Japan, 81 432262372.
  • Department of Preventive Services, Kyoto University Graduate School of Medicine, Kyoto, Japan.
  • Health Services and Systems Research, Duke-NUS Medical School, National University of Singapore, Singapore, Singapore.

ORCID profiles: Takehiko Oami, Yohei Okada, Taka-Aki Nakada

Cite

APA

Oami, T., Okada, Y., & Nakada, T. A. (2025). GPT-3.5 Turbo and GPT-4 Turbo in Title and Abstract Screening for Systematic Reviews. JMIR Medical Informatics, 13, e64682-e64682. https://doi.org/10.2196/64682

Vancouver

Oami T, Okada Y, Nakada TA. GPT-3.5 Turbo and GPT-4 Turbo in Title and Abstract Screening for Systematic Reviews. JMIR Medical Informatics. 2025;13:e64682-e64682. doi:10.2196/64682

BibTeX
@article{Oami2025,
  author = {Oami, Takehiko and Okada, Yohei and Nakada, Taka-Aki},
  title = {GPT-3.5 Turbo and GPT-4 Turbo in Title and Abstract Screening for Systematic Reviews},
  journal = {JMIR Medical Informatics},
  year = {2025},
  volume = {13},
  pages = {e64682--e64682},
  doi = {10.2196/64682}
}
Start for free →