EUVIMEDEUVIMED entdecken
Crossref

Evaluating Plastic Surgery Chatbot Performance: Insights into Medical Triage, Classification Accuracy, and Escalation Trends

Sophia Wolmer, Orr Shauly iD

Aesthetic Surgery Journal · 29.01.2026 · 46 (2) · 122-129

DOI: 10.1093/asj/sjaf123 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Aesthetic Surgery Journal, online erschienen am 14.07.2025. Verfasst von Sophia Wolmer und 1 weiteren Autor:innen. Beteiligte Einrichtung: Emory University School of Medicine, Atlanta, GA, USA. Hauptthemen laut MEDLINE: Triage, Surgery, Plastic, Internet, Artificial Intelligence. Die Arbeit nennt 17 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

The integration of AI chatbots into plastic surgery websites is now standard, providing asynchronous, real-time engagement for patients. Although promoted as scheduling and medical guidance tools, their contribution to clinical workflow improvement and patient satisfaction remains unclear.

Objectives

The aim of this study was to evaluate the accuracy of AI chatbot performance in clinical triage of plastic surgery patients, focusing on triage accuracy and quality of patient interactions.

Methods

The responses of chatbots on top-ranking plastic surgery websites, identified by search engine optimization (SEO) rankings, were analyzed with standardized clinical scenarios representing emergent, urgent, and elective patient inquiries. Responses were analyzed by the chatbot's triage sensitivity and specificity, classification accuracy, escalation metrics, and content quality. Patient experience was quantified with a chatbot usability questionnaire and a visual analog scale. Subgroup analysis by chatbot platform and thematic analysis was performed to identify tonal patterns in chatbot language.

Results

Performance varied significantly across 60 clinical scenarios, particularly in urgency classification. Emergent classifications were most mislabeled as urgent, with a low sensitivity (20%), negative predictive value (0.71), and high false negative rate (80.0%). Agreement with physician-determined classifications was moderate (Cohen’s kappa = 0.47), and over half of conversations required human-provider escalation. Misclassified interactions were associated with lower patient usability scores compared to correct classifications (49.1 vs 60.8, P < .05). Thematic analysis revealed reliance on templated, administrative language.

Conclusions

Chatbots are practical and useful tools for managing elective plastic surgery inquiries but are ill-equipped to handle urgent and emergent patient needs. To move beyond utilization as basic administrative assistants, deployment of more clinically adept chatbots is needed.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

TriageSurgery, PlasticInternetArtificial IntelligencePlastic Surgery ProceduresHumansPatient SatisfactionSurveys and QuestionnairesWorkflowGenerative Artificial Intelligence

Autor:innen und Institutionen

  • Emory University School of Medicine, Atlanta, GA, USA.

ORCID-Profile: Orr Shauly

Zitieren

APA

Wolmer, S., & Shauly, O. (2026). Evaluating Plastic Surgery Chatbot Performance: Insights into Medical Triage, Classification Accuracy, and Escalation Trends. Aesthetic Surgery Journal, 46(2), 122-129. https://doi.org/10.1093/asj/sjaf123

Vancouver

Wolmer S, Shauly O. Evaluating Plastic Surgery Chatbot Performance: Insights into Medical Triage, Classification Accuracy, and Escalation Trends. Aesthetic Surgery Journal. 2026;46(2):122-129. doi:10.1093/asj/sjaf123

BibTeX
@article{Wolmer2026,
  author = {Wolmer, Sophia and Shauly, Orr},
  title = {Evaluating Plastic Surgery Chatbot Performance: Insights into Medical Triage, Classification Accuracy, and Escalation Trends},
  journal = {Aesthetic Surgery Journal},
  year = {2026},
  volume = {46},
  number = {2},
  pages = {122--129},
  doi = {10.1093/asj/sjaf123}
}
Kostenlos starten →