Evaluating DeepResearch and DeepThink in anterior cruciate ligament surgery patient education: ChatGPT‐4o excels in comprehensiveness, DeepSeek R1 leads in clarity and readability of orthopaedic information
Bewertung von DeepResearch und DeepThink in der Patientenedukation zur vorderen Kreuzbandchirurgie: ChatGPT-4o überzeugt durch Vollständigkeit, DeepSeek R1 durch Klarheit und Lesbarkeit orthopädischer Informationen
Knee Surgery, Sports Traumatology, Arthroscopy · 2025-08 · 33 (8) · 3025-3031
DOI: 10.1002/ksa.12711 ↗Auf einen Blick
ChatGPT-4o und DeepSeek R1 lieferten zu FAQs zur ACL-Operation hohe Genauigkeit. ChatGPT war vollständiger, DeepSeek klarer und besser lesbar.
Fragestellung
Wie schneiden ChatGPT-4o mit DeepResearch und DeepSeek R1 mit DeepThink bei FAQs zur ACL-Operation hinsichtlich Genauigkeit, Klarheit, Vollständigkeit, Konsistenz und Lesbarkeit ab?
Methode
Vergleichende Studie mit 10 FAQs zur ACL-Operation; Antworten von Orthopädie-Sportchirurgen auf Genauigkeit, Klarheit, Vollständigkeit und Konsistenz bewertet; Lesbarkeit mit FKGL und FRES geprüft.
Ergebnisse
Beide Modelle: hohe Genauigkeit (3,9/4) und Konsistenz (4/4). ChatGPT: Vollständigkeit 4,0 vs. 3,2; DeepSeek: Klarheit 3,9 vs. 3,0. FKGL 8,9 vs. 14,2; FRES 61,3 vs. 32,7. Composite ICC 0,80.
Schlussfolgerung der Autor:innen
ChatGPT-4o und DeepSeek R1 lieferten beide hochwertige, genaue Informationen zur Patientenedukation bei ACL-Operationen. ChatGPT war vollständiger, DeepSeek klarer und besser lesbar.
Kernaussagen
- Beide Modelle erreichten hohe Genauigkeit und Konsistenz.
- ChatGPT war vollständiger als DeepSeek.
- DeepSeek war klarer und besser lesbar als ChatGPT.
Deutsche Zusammenfassung: KI-gestützt aus dem Original-Abstract erstellt; alle Zahlen wurden automatisch mit dem Original abgeglichen. Maßgeblich ist der Original-Abstract.
Kurz gefasst
Vergleichsstudie in der Zeitschrift Knee Surgery, Sports Traumatology, Arthroscopy, 2025-06. Verfasst von Onur Gültekin und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Orthopaedics and Traumatology, Istanbul Fatih Sultan Mehmet Training and Research Hospital, University of Health Sciences, Istanbul, Tu…. Hauptthemen laut MEDLINE: Anterior Cruciate Ligament Reconstruction, Comprehension, Patient Education as Topic, Anterior Cruciate Ligament Injuries. Die Arbeit wurde bisher 45-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Themen: Selbstmanagement bei chronischen Erkrankungen, Künstliche Intelligenz in der Pflege
Abstract (Originalsprache)
Purpose
This study compares ChatGPT‐4o, equipped with its deep research feature, and DeepSeek R1, equipped with its deepthink feature—both enabling real‐time online data access—in generating responses to frequently asked questions (FAQs) about anterior cruciate ligament (ACL) surgery. The aim is to evaluate and compare their performance in terms of accuracy, clarity, completeness, consistency and readibility for evidence‐based patient education.
Methods
A list of ten FAQs about ACL surgery was compiled after reviewing the Sports Medicine Fellowship Institution's webpages. These questions were posed to ChatGPT and DeepSeek in research‐enabled modes. Orthopaedic sports surgeons evaluated the responses for accuracy, clarity, completeness, and consistency using a 4‐point Likert scale. Inter‐rater reliability of the evaluations was assessed using intraclass correlation coefficients (ICCs). In addition, a readability analysis was conducted using the Flesch–Kincaid Grade Level (FKGL) and Flesch Reading Ease Score (FRES) metrics via an established online calculator to objectively measure textual complexity. Paired t tests were used to compare the mean scores of the two models for each criterion, with significance set at p < 0.05.
Results
Both models demonstrated high accuracy (mean scores of 3.9/4) and consistency (4/4). Significant differences were observed in clarity and completeness: ChatGPT provided more comprehensive responses (mean completeness 4.0 vs. 3.2, p < 0.001), while DeepSeek's answers were clearer and more accessible to laypersons (mean clarity 3.9 vs. 3.0, p < 0.001). DeepSeek had lower FKGL (8.9 vs. 14.2, p < 0.001) and higher FRES (61.3 vs. 32.7, p < 0.001), indicating greater ease of reading for a general audience. ICC analysis indicated substantial inter‐rater agreement (composite ICC = 0.80).
Conclusion
ChatGPT‐4o, leveraging its deep research feature, and DeepSeek R1, utilizing its deepthink feature, both deliver high‐quality, accurate information for ACL surgery patient education. While ChatGPT excels in comprehensiveness, DeepSeek outperforms in clarity and readability, suggesting that integrating the strengths of both models could optimize patient education outcomes. Level of Evidence Level V.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Orthopaedics and Traumatology, Istanbul Fatih Sultan Mehmet Training and Research Hospital, University of Health Sciences, Istanbul, Turkey.
- Department of Orthopaedic Surgery, Nagoya Tokushukai General Hospital, Kasugai, Aichi, Japan.
- Department of Orthopedics and Traumatology, Memorial Sisli Hospital, Istanbul, Turkey.
- Department of Orthopaedics and Traumatology, Istanbul Kartal Dr. Lutfi Kirdar City Hospital, Istanbul, Turkey.
- Department of Orthopaedics and Traumatology, Brandenburg Medical School Theodor Fontane, University Hospital Brandenburg/Havel, Brandenburg/Havel, Germany.
- Faculty of Health Sciences Brandenburg, Brandenburg Medical School Theodor Fontane, Brandenburg/Havel, Germany.
ORCID-Profile: Mahmut Enes Kayaalp
Zitieren
APA
Gültekin, O., Inoue, J., Yilmaz, B., Cerci, M. H., Kilinc, B. E., Yilmaz, H., Prill, R., & Kayaalp, M. E. (2025). Evaluating DeepResearch and DeepThink in anterior cruciate ligament surgery patient education: ChatGPT‐4o excels in comprehensiveness, DeepSeek R1 leads in clarity and readability of orthopaedic information. Knee Surgery, Sports Traumatology, Arthroscopy, 33(8), 3025-3031. https://doi.org/10.1002/ksa.12711
Vancouver
Gültekin O, Inoue J, Yilmaz B, Cerci MH, Kilinc BE, Yilmaz H, et al. Evaluating DeepResearch and DeepThink in anterior cruciate ligament surgery patient education: ChatGPT‐4o excels in comprehensiveness, DeepSeek R1 leads in clarity and readability of orthopaedic information. Knee Surgery, Sports Traumatology, Arthroscopy. 2025;33(8):3025-3031. doi:10.1002/ksa.12711
BibTeX
@article{Gltekin2025,
author = {Gültekin, Onur and Inoue, Jumpei and Yilmaz, Baris and Cerci, Mehmet Halis and Kilinc, Bekir Eray and Yilmaz, Hüsnü and Prill, Robert and Kayaalp, Mahmut Enes},
title = {Evaluating DeepResearch and DeepThink in anterior cruciate ligament surgery patient education: ChatGPT‐4o excels in comprehensiveness, DeepSeek R1 leads in clarity and readability of orthopaedic information},
journal = {Knee Surgery, Sports Traumatology, Arthroscopy},
year = {2025},
volume = {33},
number = {8},
pages = {3025--3031},
doi = {10.1002/ksa.12711}
}
EUVIMED