EUVIMEDEUVIMED entdecken
Vergleichsstudie

Evaluation Large Language Models’ Time Dependent Consistency in Aesthetic Surgery Consultations and Comparison of Their Performance Across Different Clinical Domains

Munur Selcuk Kendir iD, Muaz Zuhurlu

Aesthetic Plastic Surgery · 2026-05 · 50 (9) · 3485-3496

DOI: 10.1007/s00266-025-05308-7 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Aesthetic Plastic Surgery, online erschienen am 22.10.2025. Verfasst von Munur Selcuk Kendir und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Plastic and Reconstructive and Aesthetic Surgery, Acibadem University, School of Medicine, Istanbul, Turkey. selcuk_kendir@msn.com. Hauptthemen laut MEDLINE: Surgery, Plastic, Referral and Consultation, Plastic Surgery Procedures, Language. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 34 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

BACKGROUND: The integration of large language models (LLM) into plastic and aesthetic surgery has shown promise. However, research comparing different LLMs in handling clinical scenarios and their temporal consistency remains limited. This study evaluated the performances of ChatGPT-4o, Gemini 1.5 Pro and Claude 3.5 Sonnet in aesthetic surgery scenarios. The objectives were to compare their overall performance, analyze reliability in complicated and uncomplicated cases, assess temporal consistency, evaluate performance across five clinical domains: preoperative cautions, postoperative care, holistic approach, algorithmic approach, and surgical planning. METHODS: Twenty-four case scenarios (12 complicated, 12 uncomplicated) were input into the LLMs at three time points (T1, T2, T3) over two weeks. Three blinded board-certified plastic surgeons evaluated responses using a 5-point Likert scale. Statistical analyses were applied. RESULTS: Chat GPT-4 achieved the highest mean score (4.92), outperforming Gemini 1.5 Pro (3.62) and Claude 3.5 Sonnet (3.21) (p 0.05) and demonstrated temporal stability (p > 0.05). Gemini 1.5 Pro showed temporal consistency for complicated cases (p > 0.05), but not in uncomplicated cases. Claude 3.5 Sonnet exhibited significant temporal inconsistencies (p < 0.05). In the domain specific analyzes, GPT-4 was superior to others. Claude 3.5 Sonnet had the lowest scores in most domains, except algorithmic approach, where it outperformed Gemini (4.4 vs. 4.1, p < 0.05). CONCLUSIONS: LLMs could be a promising tool for supporting surgical decision-making. Future research should aim to enhance LLM reliability and validate its real-world applications. LEVEL OF EVIDENCE I: This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Surgery, PlasticReferral and ConsultationPlastic Surgery ProceduresLanguageHumansFemaleMaleReproducibility of ResultsAdultTime FactorsMiddle AgedLarge Language Models

Stichwörter der Autor:innen

Aesthetic surgery consultationArtificial intelligenceLarge language modelsTime dependent consistency

Autor:innen und Institutionen

  • Department of Plastic and Reconstructive and Aesthetic Surgery, Acibadem University, School of Medicine, Istanbul, Turkey. selcuk_kendir@msn.com.
  • Sakarya Training and Research Hospital, Sakarya, Turkey.

ORCID-Profile: Munur Selcuk Kendir

Zitieren

APA

Kendir, M. S., & Zuhurlu, M. (2026). Evaluation Large Language Models’ Time Dependent Consistency in Aesthetic Surgery Consultations and Comparison of Their Performance Across Different Clinical Domains. Aesthetic Plastic Surgery, 50(9), 3485-3496. https://doi.org/10.1007/s00266-025-05308-7

Vancouver

Kendir MS, Zuhurlu M. Evaluation Large Language Models’ Time Dependent Consistency in Aesthetic Surgery Consultations and Comparison of Their Performance Across Different Clinical Domains. Aesthetic Plastic Surgery. 2026;50(9):3485-3496. doi:10.1007/s00266-025-05308-7

BibTeX
@article{Kendir2026,
  author = {Kendir, Munur Selcuk and Zuhurlu, Muaz},
  title = {Evaluation Large Language Models’ Time Dependent Consistency in Aesthetic Surgery Consultations and Comparison of Their Performance Across Different Clinical Domains},
  journal = {Aesthetic Plastic Surgery},
  year = {2026},
  volume = {50},
  number = {9},
  pages = {3485--3496},
  doi = {10.1007/s00266-025-05308-7}
}
Kostenlos starten →