EUVIMEDEUVIMED entdecken
Crossref

Real‐world deployment and evaluation of PEri ‐operative AI CHatbot ( PEACH ): a large language model chatbot for peri‐operative medicine

Yu He Ke iD, Liyuan Jin, Kabilan Elangovan, Bryan Wen Xi Ong, Chin Yang Oh, Jacqueline Sim, Kenny Wei-Tsen Loh, Chai Rick Soh, Jonathan Ming Hua Cheng, Aaron Kwang Yang Lee, Daniel Shu Wei Ting, Nan Liu und 1 weitere

Anaesthesia · 2026-01 · 81 (1) · 62-71

DOI: 10.1111/anae.16755 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Anaesthesia, online erschienen am 19.09.2025. Verfasst von Yu He Ke und 12 weiteren Autor:innen. Beteiligte Einrichtung: Department of Anaesthesiology, Singapore General Hospital, Singapore. Hauptthemen laut MEDLINE: Perioperative Care, Artificial Intelligence, Language. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 26 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Large Language Models are emerging as powerful tools in healthcare, particularly for complex, domain‐specific tasks. This study describes the development and evaluation of PEri‐operative AI CHatbot (PEACH). It was developed by embedding 35 institutional peri‐operative protocols into a secure large language model environment, with iterative prompt engineering and internal testing to ensure clinical relevance and accuracy.

Methods

The system was tested with a silent deployment using real‐world data. Accuracy, safety and usability were assessed. Accuracy was evaluated by comparing the responses from PEACH against institutional guidelines and expert consensus. Deviations and hallucinations were categorised based on potential harm, and user feedback was evaluated using the Davis' Technology Acceptance Model. Updates to PEACH were made after the initial silent deployment to make minor amendments to one of the protocols.

Results

In total, 240 real‐world clinical iterations were evaluated. First‐generation accuracy was 97.5% (78/80), with an overall accuracy of 96.7% (232/240) across three iterations. In the updated PEACH, accuracy improved to 97.9% (235/240), with a statistically significant difference from the null hypothesis of 95% accuracy (p = 0.018). Hallucinations and deviations were minimal (1/240 and 2/240, respectively). There was high usability, with clinicians noting that PEACH expedited decisions in 95% of cases. The κ statistic for inter‐rater reliability for PEACH was 0.772 and 0.893 between three iterations, compared with 0.610 and 0.784 for experienced peri‐operative physicians.

Discussion

PEACH is an accurate, adaptable tool that enhances consistency and efficiency in peri‐operative decision‐making. Future research should explore scalability across specialties and its impact on clinical outcomes.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Perioperative CareArtificial IntelligenceLanguageHumansLarge Language ModelsGenerative Artificial Intelligence

Stichwörter der Autor:innen

artificial intelligenceclinical decision supportlarge language modelperi‐operative medicine

Autor:innen und Institutionen

  • Department of Anaesthesiology, Singapore General Hospital, Singapore.
  • Data Science and Artificial Intelligence Lab, Singapore General Hospital, Singapore.
  • Duke-NUS Medical School, Singapore.
  • Artificial Intelligence Office Singhealth, Singapore.
  • Open Government Products, Singapore.
  • Department of Surgical Retina, Singapore National Eye Centre, Singapore.

ORCID-Profile: Yu He Ke

Zitieren

APA

Ke, Y. H., Jin, L., Elangovan, K., Ong, B. W. X., Oh, C. Y., Sim, J., Loh, K. W., Soh, C. R., Cheng, J. M. H., Lee, A. K. Y., Ting, D. S. W., Liu, N., & Abdullah, H. R. (2026). Real‐world deployment and evaluation of PEri ‐operative AI CHatbot ( PEACH ): a large language model chatbot for peri‐operative medicine. Anaesthesia, 81(1), 62-71. https://doi.org/10.1111/anae.16755

Vancouver

Ke YH, Jin L, Elangovan K, Ong BWX, Oh CY, Sim J, et al. Real‐world deployment and evaluation of PEri ‐operative AI CHatbot ( PEACH ): a large language model chatbot for peri‐operative medicine. Anaesthesia. 2026;81(1):62-71. doi:10.1111/anae.16755

BibTeX
@article{Ke2026,
  author = {Ke, Yu He and Jin, Liyuan and Elangovan, Kabilan and Ong, Bryan Wen Xi and Oh, Chin Yang and Sim, Jacqueline and Loh, Kenny Wei-Tsen and Soh, Chai Rick and Cheng, Jonathan Ming Hua and Lee, Aaron Kwang Yang and Ting, Daniel Shu Wei and Liu, Nan and Abdullah, Hairil Rizal},
  title = {Real‐world deployment and evaluation of PEri ‐operative AI CHatbot ( PEACH ): a large language model chatbot for peri‐operative medicine},
  journal = {Anaesthesia},
  year = {2026},
  volume = {81},
  number = {1},
  pages = {62--71},
  doi = {10.1111/anae.16755}
}
Kostenlos starten →