Accuracy of ChatGPT, Gemini, Copilot, and Claude to Blepharoplasty-Related Questions
Aesthetic Plastic Surgery · 2025-09 · 49 (17) · 4775-4785
DOI: 10.1007/s00266-025-05071-9 ↗Kurz gefasst
Fachartikel in der Zeitschrift Aesthetic Plastic Surgery, online erschienen am 21.07.2025. Verfasst von Seher Köksaldı und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Ophthalmology, Agri Ibrahim Cecen University, 04200, Agri, Turkey. seherkoksaldi@gmail.com. Hauptthemen laut MEDLINE: Blepharoplasty, Language. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 24 Literaturangaben.
Abstract (Originalsprache)
BACKGROUND: This study aimed to evaluate the performance of four large language models (LLMs)-ChatGPT, Gemini, Copilot, and Claude-in responding to upper eyelid blepharoplasty-related questions, focusing on medical accuracy, clinical relevance, response length, and readability. METHODS: A set of queries regarding upper eyelid blepharoplasty, covering six categories (anatomy, surgical procedure, additional intraoperative procedures, postoperative monitoring, follow-up, and postoperative complications) were posed to each LLM. An identical prompt establishing clinical context was provided before each question. Responses were evaluated by three ophthalmologists using a 5-point Likert scale for medical accuracy and a 3-point Likert scale for clinical relevance. The length of the responses was assessed. Readability was also evaluated using the Flesch Reading Ease Score, Flesch-Kincaid Grade Level, Coleman-Liau Index, Gunning Fog Index, and Simple Measure of Gobbledygook grade. RESULTS: A total of 30 standardized questions were presented to each LLM. None of the responses from any LLM received a score of 1 regarding medical accuracy for any question. ChatGPT achieved an 80% 'highly accurate' response rate, followed by Claude (60%), Gemini (40%), and Copilot (20%). None of the responses from ChatGPT and Claude received a score of 1 regarding clinical relevance, whereas 10% of Gemini's responses and 26.7% of Copilot's responses received a score of 1. ChatGPT also provided the most clinically 'relevant' responses (86.7%), outperforming the other LLMs. Copilot generated the shortest responses, while ChatGPT generated the longest. Readability analyses revealed that all responses required advanced reading skills at a 'college graduate' level or higher, with Copilot's responses being the most complex. CONCLUSION: ChatGPT demonstrated superior performance in both medical accuracy and clinical relevance among evaluated LLMs regarding upper eyelid blepharoplasty, particularly excelling in postoperative monitoring and follow-up categories. While all models generated complex texts requiring advanced literacy, ChatGPT's detailed responses offer valuable guidance for ophthalmologists managing upper eyelid blepharoplasty cases. LEVEL OF EVIDENCE V: This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Ophthalmology, Agri Ibrahim Cecen University, 04200, Agri, Turkey. seherkoksaldi@gmail.com.
- Department of Ophthalmology, Mus State Hospital, 49200, Mus, Turkey.
- Department of Ophthalmology, Izmir Democracy University Buca Seyfi Demirsoy Education and Research Hospital, 35390, Izmir, Turkey.
- Department of Ophthalmology, University of Warmia and Mazury, 10-719, Olsztyn, Poland. ae.grzybowski@gmail.com.
- Institute for Research in Ophthalmology, Foundation for Ophthalmology Development, 61-553, Poznan, Poland. ae.grzybowski@gmail.com.
ORCID-Profile: Seher Köksaldı, Mustafa Kayabaşı, Ceren Durmaz Engin, Andrzej Grzybowski
Zitieren
APA
Köksaldı, S., Kayabaşı, M., Durmaz Engin, C., & Grzybowski, A. (2025). Accuracy of ChatGPT, Gemini, Copilot, and Claude to Blepharoplasty-Related Questions. Aesthetic Plastic Surgery, 49(17), 4775-4785. https://doi.org/10.1007/s00266-025-05071-9
Vancouver
Köksaldı S, Kayabaşı M, Durmaz Engin C, Grzybowski A. Accuracy of ChatGPT, Gemini, Copilot, and Claude to Blepharoplasty-Related Questions. Aesthetic Plastic Surgery. 2025;49(17):4775-4785. doi:10.1007/s00266-025-05071-9
BibTeX
@article{Kksald2025,
author = {Köksaldı, Seher and Kayabaşı, Mustafa and Durmaz Engin, Ceren and Grzybowski, Andrzej},
title = {Accuracy of ChatGPT, Gemini, Copilot, and Claude to Blepharoplasty-Related Questions},
journal = {Aesthetic Plastic Surgery},
year = {2025},
volume = {49},
number = {17},
pages = {4775--4785},
doi = {10.1007/s00266-025-05071-9}
}
EUVIMED