Man Versus Machine: A Comparative Study of Human and ChatGPT-Generated Abstracts in Plastic Surgery Research
Aesthetic Plastic Surgery · 2025
DOI: 10.1007/s00266-025-04836-6 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Aesthetic Plastic Surgery, 2025. Verfasst von Sophia M Pressman und 6 weiteren Autor:innen. Beteiligte Einrichtung: Division of Plastic Surgery, Mayo Clinic, 4500 San Pablo Rd, Jacksonville, FL, 32224, USA. Hauptthemen laut MEDLINE: Surgery, Plastic, Abstracting and Indexing, Biomedical Research, Periodicals as Topic. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 26 Literaturangaben.
Abstract (Originalsprache)
BACKGROUND: Since its 2022 release, ChatGPT has gained recognition for its potential to expedite time-consuming writing tasks like scientific writing. Well-written scientific abstracts are essential for clear and efficient communication of research findings. This study aims to explore ChatGPT-4's capability to produce well-crafted abstracts. METHODS: Ten abstract-less plastic surgery articles from PubMed were uploaded to ChatGPT, each with a prompt to generate one abstract. Flesch-Kincaid Grade Level (FKGL) and Flesch Reading Ease Score (FRES) were calculated for all abstracts. Additionally, three physician evaluators blindly assessed the ten original and ten ChatGPT-generated abstracts using a 5-point Likert scale. Results were compared and analyzed using descriptive statistics with mean and standard deviation (SD). RESULTS: The original abstracts averaged an FKGL of 14.1 (SD 2.9) and an FRES of 25.2 (SD 14.2), while ChatGPT-generated abstracts had scores of 15.6 (SD 2.4) and 15.4 (SD 13.1), respectively. Collectively, evaluators identified two-thirds of the ChatGPT abstracts, but preferred the ChatGPT abstracts 90% of the time. On average, the evaluators found the ChatGPT abstracts to be more "well written" (4.23 vs. 3.50, p value < 0.001) and "clear and concise" (4.30 vs. 3.53, p value < 0.001) compared to the original abstracts. CONCLUSIONS: Despite a slightly higher reading level, evaluators generally preferred ChatGPT abstracts, which received higher ratings overall. These findings suggest ChatGPT holds promise in expediting the creation of high-quality scientific abstracts, potentially enhancing efficiency in research and scientific writing tasks. However, due to its exploratory nature, this study calls for additional research to validate these promising findings. LEVEL OF EVIDENCE IV: This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Division of Plastic Surgery, Mayo Clinic, 4500 San Pablo Rd, Jacksonville, FL, 32224, USA.
- Department of General Surgery, Mayo Clinic, Rochester, MN, USA.
- Department of Physiology and Biomedical Engineering, Mayo Clinic, Rochester, MN, USA.
- Division of Plastic Surgery, Mayo Clinic, 4500 San Pablo Rd, Jacksonville, FL, 32224, USA. ajvforte@yahoo.com.br.
- Center for Digital Health, Mayo Clinic, Rochester, MN, USA. ajvforte@yahoo.com.br.
ORCID-Profile: Antonio Jorge Forte
Zitieren
APA
Pressman, S. M., Garcia, J. P., Borna, S., Gomez-Cabello, C. A., Haider, S. A., Haider, C. R., & Forte, A. J. (2025). Man Versus Machine: A Comparative Study of Human and ChatGPT-Generated Abstracts in Plastic Surgery Research. Aesthetic Plastic Surgery. https://doi.org/10.1007/s00266-025-04836-6
Vancouver
Pressman SM, Garcia JP, Borna S, Gomez-Cabello CA, Haider SA, Haider CR, et al. Man Versus Machine: A Comparative Study of Human and ChatGPT-Generated Abstracts in Plastic Surgery Research. Aesthetic Plastic Surgery. 2025. doi:10.1007/s00266-025-04836-6
BibTeX
@article{Pressman2025,
author = {Pressman, Sophia M and Garcia, John P and Borna, Sahar and Gomez-Cabello, Cesar A and Haider, Syed Ali and Haider, Clifton R and Forte, Antonio Jorge},
title = {Man Versus Machine: A Comparative Study of Human and ChatGPT-Generated Abstracts in Plastic Surgery Research},
journal = {Aesthetic Plastic Surgery},
year = {2025},
doi = {10.1007/s00266-025-04836-6}
}
EUVIMED