EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

ChatENT: Augmented Large Language Model for Expert Knowledge Retrieval in Otolaryngology–Head and Neck Surgery

Cai Long iD, Deepak Subburam iD, Kayle Lowe iD, André Dos Santos, Jessica Zhang iD, Sang Hwang, Neil Saduka, Yoav Horev, Tao Su, David W J Côté, Erin D Wright

Otolaryngology–Head and Neck Surgery · 2024-10 · 171 (4) · 1042-1051

DOI: 10.1002/ohn.864 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Otolaryngology–Head and Neck Surgery, online erschienen am 19.06.2024. Verfasst von Cai Long und 10 weiteren Autor:innen. Beteiligte Einrichtung: Division of Otolaryngology-Head and Neck Surgery, University of Alberta, Edmonton, Alberta, Canada. Hauptthemen laut MEDLINE: Otolaryngology. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

The recent surge in popularity of large language models (LLMs), such as ChatGPT, has showcased their proficiency in medical examinations and potential applications in health care. However, LLMs possess inherent limitations, including inconsistent accuracy, specific prompting requirements, and the risk of generating harmful hallucinations. A domain‐specific model might address these limitations effectively. Study Design Developmental design.

Setting

Virtual.

Methods

Otolaryngology–head and neck surgery (OHNS) relevant data were systematically gathered from open‐access Internet sources and indexed into a knowledge database. We leveraged Retrieval‐Augmented Language Modeling to recall this information and utilized it for pretraining, which was then integrated into ChatGPT4.0, creating an OHNS‐specific knowledge question & answer platform known as ChatENT. The model is further tested on different types of questions.

Results

ChatENT showed enhanced performance in the analysis and interpretation of OHNS information, outperforming ChatGPT4.0 in both the Canadian Royal College OHNS sample examination questions challenge and the US board practice questions challenge, with a 58.4% and 26.0% error reduction, respectively. ChatENT generated fewer hallucinations and demonstrated greater consistency.

Conclusion

To the best of our knowledge, ChatENT is the first specialty‐specific knowledge retrieval artificial intelligence in the medical field that utilizes the latest LLM. It appears to have considerable promise in areas such as medical education, patient education, and clinical decision support. The model has demonstrated the capacity to overcome the limitations of existing LLMs, thereby signaling a future of more precise, safe, and user‐friendly applications in the realm of OHNS and other medical fields.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

OtolaryngologyHumansInformation Storage and RetrievalOtorhinolaryngologic Surgical ProceduresLanguage

Stichwörter der Autor:innen

artificial intelligenceaugmented language modelingdigital healthear, nose and throatlanguage modelslarge language modelleveraged retrievalotolaryngology

Autor:innen und Institutionen

  • Division of Otolaryngology-Head and Neck Surgery, University of Alberta, Edmonton, Alberta, Canada.
  • Copula AI, New York, New York, USA.
  • Faculty of Medicine, University of Alberta, Edmonton, Alberta, Canada.
  • Alberta Machine Intelligence Institute, Edmonton, Alberta, Canada.
  • Reeder AI, New York, New York, USA.

ORCID-Profile: Cai Long, Deepak Subburam, Kayle Lowe, Jessica Zhang

Zitieren

APA

Long, C., Subburam, D., Lowe, K., Dos Santos, A., Zhang, J., Hwang, S., Saduka, N., Horev, Y., Su, T., Côté, D. W. J., & Wright, E. D. (2024). ChatENT: Augmented Large Language Model for Expert Knowledge Retrieval in Otolaryngology–Head and Neck Surgery. Otolaryngology–Head and Neck Surgery, 171(4), 1042-1051. https://doi.org/10.1002/ohn.864

Vancouver

Long C, Subburam D, Lowe K, Dos Santos A, Zhang J, Hwang S, et al. ChatENT: Augmented Large Language Model for Expert Knowledge Retrieval in Otolaryngology–Head and Neck Surgery. Otolaryngology–Head and Neck Surgery. 2024;171(4):1042-1051. doi:10.1002/ohn.864

BibTeX
@article{Long2024,
  author = {Long, Cai and Subburam, Deepak and Lowe, Kayle and Dos Santos, André and Zhang, Jessica and Hwang, Sang and Saduka, Neil and Horev, Yoav and Su, Tao and Côté, David W J and Wright, Erin D},
  title = {ChatENT: Augmented Large Language Model for Expert Knowledge Retrieval in Otolaryngology–Head and Neck Surgery},
  journal = {Otolaryngology–Head and Neck Surgery},
  year = {2024},
  volume = {171},
  number = {4},
  pages = {1042--1051},
  doi = {10.1002/ohn.864}
}
Kostenlos starten →