Evaluating Plastic Surgery Chatbot Performance: Insights into Medical Triage, Classification Accuracy, and Escalation Trends
Aesthetic Surgery Journal · 29.01.2026 · 46 (2) · 122-129
DOI: 10.1093/asj/sjaf123 ↗Kurz gefasst
Fachartikel in der Zeitschrift Aesthetic Surgery Journal, online erschienen am 14.07.2025. Verfasst von Sophia Wolmer und 1 weiteren Autor:innen. Beteiligte Einrichtung: Emory University School of Medicine, Atlanta, GA, USA. Hauptthemen laut MEDLINE: Triage, Surgery, Plastic, Internet, Artificial Intelligence. Die Arbeit nennt 17 Literaturangaben.
Abstract (Originalsprache)
Background
The integration of AI chatbots into plastic surgery websites is now standard, providing asynchronous, real-time engagement for patients. Although promoted as scheduling and medical guidance tools, their contribution to clinical workflow improvement and patient satisfaction remains unclear.
Objectives
The aim of this study was to evaluate the accuracy of AI chatbot performance in clinical triage of plastic surgery patients, focusing on triage accuracy and quality of patient interactions.
Methods
The responses of chatbots on top-ranking plastic surgery websites, identified by search engine optimization (SEO) rankings, were analyzed with standardized clinical scenarios representing emergent, urgent, and elective patient inquiries. Responses were analyzed by the chatbot's triage sensitivity and specificity, classification accuracy, escalation metrics, and content quality. Patient experience was quantified with a chatbot usability questionnaire and a visual analog scale. Subgroup analysis by chatbot platform and thematic analysis was performed to identify tonal patterns in chatbot language.
Results
Performance varied significantly across 60 clinical scenarios, particularly in urgency classification. Emergent classifications were most mislabeled as urgent, with a low sensitivity (20%), negative predictive value (0.71), and high false negative rate (80.0%). Agreement with physician-determined classifications was moderate (Cohen’s kappa = 0.47), and over half of conversations required human-provider escalation. Misclassified interactions were associated with lower patient usability scores compared to correct classifications (49.1 vs 60.8, P < .05). Thematic analysis revealed reliance on templated, administrative language.
Conclusions
Chatbots are practical and useful tools for managing elective plastic surgery inquiries but are ill-equipped to handle urgent and emergent patient needs. To move beyond utilization as basic administrative assistants, deployment of more clinically adept chatbots is needed.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Emory University School of Medicine, Atlanta, GA, USA.
ORCID-Profile: Orr Shauly
Zitieren
APA
Wolmer, S., & Shauly, O. (2026). Evaluating Plastic Surgery Chatbot Performance: Insights into Medical Triage, Classification Accuracy, and Escalation Trends. Aesthetic Surgery Journal, 46(2), 122-129. https://doi.org/10.1093/asj/sjaf123
Vancouver
Wolmer S, Shauly O. Evaluating Plastic Surgery Chatbot Performance: Insights into Medical Triage, Classification Accuracy, and Escalation Trends. Aesthetic Surgery Journal. 2026;46(2):122-129. doi:10.1093/asj/sjaf123
BibTeX
@article{Wolmer2026,
author = {Wolmer, Sophia and Shauly, Orr},
title = {Evaluating Plastic Surgery Chatbot Performance: Insights into Medical Triage, Classification Accuracy, and Escalation Trends},
journal = {Aesthetic Surgery Journal},
year = {2026},
volume = {46},
number = {2},
pages = {122--129},
doi = {10.1093/asj/sjaf123}
}
EUVIMED