EUVIMEDEUVIMED entdecken
Crossref

Enhancing systematic reviews in orthodontics: a comparative examination of GPT-3.5 and GPT-4 for generating PICO-based queries with tailored prompts and configurations

Gizem Boztaş Demir, Yağızalp Süküt, Gökhan Serhat Duran, Kübra Gülnur Topsakal, Serkan Görgülü

European Journal of Orthodontics · 01.04.2024 · 46 (2)

DOI: 10.1093/ejo/cjae011 ↗

Kurz gefasst

Fachartikel in der Zeitschrift European Journal of Orthodontics, online erschienen am 07.03.2024. Verfasst von Gizem Boztaş Demir und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Orthodontics, Gulhane Faculty of Dentistry, University of Health Sciences, Ankara, Türkiye. Hauptthemen laut MEDLINE: Dental Care, Systematic Reviews as Topic. Die Arbeit wurde bisher 39-mal zitiert (Crossref) und nennt 25 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objectives

The rapid advancement of Large Language Models (LLMs) has prompted an exploration of their efficacy in generating PICO-based (Patient, Intervention, Comparison, Outcome) queries, especially in the field of orthodontics. This study aimed to assess the usability of Large Language Models (LLMs), in aiding systematic review processes, with a specific focus on comparing the performance of ChatGPT 3.5 and ChatGPT 4 using a specialized prompt tailored for orthodontics. Materials/Methods Five databases were perused to curate a sample of 77 systematic reviews and meta-analyses published between 2016 and 2021. Utilizing prompt engineering techniques, the LLMs were directed to formulate PICO questions, Boolean queries, and relevant keywords. The outputs were subsequently evaluated for accuracy and consistency by independent researchers using three-point and six-point Likert scales. Furthermore, the PICO records of 41 studies, which were compatible with the PROSPERO records, were compared with the responses provided by the models.

Results

ChatGPT 3.5 and 4 showcased a consistent ability to craft PICO-based queries. Statistically significant differences in accuracy were observed in specific categories, with GPT-4 often outperforming GPT-3.5.

Limitations

The study’s test set might not encapsulate the full range of LLM application scenarios. Emphasis on specific question types may also not reflect the complete capabilities of the models. Conclusions/Implications Both ChatGPT 3.5 and 4 can be pivotal tools for generating PICO-driven queries in orthodontics when optimally configured. However, the precision required in medical research necessitates a judicious and critical evaluation of LLM-generated outputs, advocating for a circumspect integration into scientific investigations.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Dental CareSystematic Reviews as TopicHumans

Stichwörter der Autor:innen

ChatGPTPICO-based queriesartificial intelligence (AI)database searchprompt engineering

Autor:innen und Institutionen

  • Department of Orthodontics, Gulhane Faculty of Dentistry, University of Health Sciences, Ankara, Türkiye.

Zitieren

APA

Demir, G. B., Süküt, Y., Duran, G. S., Topsakal, K. G., & Görgülü, S. (2024). Enhancing systematic reviews in orthodontics: a comparative examination of GPT-3.5 and GPT-4 for generating PICO-based queries with tailored prompts and configurations. European Journal of Orthodontics, 46(2). https://doi.org/10.1093/ejo/cjae011

Vancouver

Demir GB, Süküt Y, Duran GS, Topsakal KG, Görgülü S. Enhancing systematic reviews in orthodontics: a comparative examination of GPT-3.5 and GPT-4 for generating PICO-based queries with tailored prompts and configurations. European Journal of Orthodontics. 2024;46(2). doi:10.1093/ejo/cjae011

BibTeX
@article{Demir2024,
  author = {Demir, Gizem Boztaş and Süküt, Yağızalp and Duran, Gökhan Serhat and Topsakal, Kübra Gülnur and Görgülü, Serkan},
  title = {Enhancing systematic reviews in orthodontics: a comparative examination of GPT-3.5 and GPT-4 for generating PICO-based queries with tailored prompts and configurations},
  journal = {European Journal of Orthodontics},
  year = {2024},
  volume = {46},
  number = {2},
  doi = {10.1093/ejo/cjae011}
}
Kostenlos starten →