EUVIMEDTutustu EUVIMEDiin
Crossref

A Novel Natural Language Processing Model for Triaging Head and Neck Patient Appointments

Stefanie Seo, Andy S Ding iD, Syed Ameen Ahmad, Kevin Z Xin, Max L Jiam, Vincent Xin, Leila J Mady, Christine G Gourin, Wojciech K Mydlarz, Nyall R London, Wayne Koch, Carole Fakhry and 1 more

Otolaryngology–Head and Neck Surgery · 2025-07 · 173 (1) · 126-133

DOI: 10.1002/ohn.1244 ↗

At a glance

Journal article in Otolaryngology–Head and Neck Surgery, published online on 2025-04-25. Written by Stefanie Seo and 12 co-authors. Institution: Department of Otolaryngology-Head and Neck Surgery, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA. Major MEDLINE topics: Natural Language Processing, Triage, Head and Neck Neoplasms, Appointments and Schedules. Cited 3 times so far (Crossref); 34 references. Funded by: National Science Foundation.

TiivistelmäSubjectsBibliografiset tiedotCiteRelated studies

Abstract (original language)

Objective

Inaccurate patient triage contributes to suboptimal clinical capacity management and delays in patient care, which in cancer patients may significantly increase morbidity and mortality. We developed a natural language processing (NLP) model as an adjunctive tool for head and neck (H&N) patient triage workflows. This study assesses the model's ability to categorize and triage patient appointments based on available documentation. Study Design A retrospective cohort study.

Setting

An academic institution.

Methods

A total of 83 new patients seeing an H&N surgeon from January to April 2024 with at least 1 referral record (clinic note, imaging, or pathology report) available were included in this study. Referral clinic, imaging, and pathology reports were entered into the NLP model to predict pathology type (non‐endocrine H&N neoplasm, thyroid, parathyroid, and benign lesions), malignancy risk, and appointment urgency. The gold standard was the final diagnosis from pathology reports or surgeons' clinic notes.

Results

The NLP model achieved an accuracy of 81.9% for pathology type and 86.8% for urgency level. Sensitivity was high for non‐endocrine H&N neoplasms (88.9%), thyroid pathology (88.9%), and parathyroid pathology (100%), although lower for benign lesions (67.9%). Specificity was 86.8% for non‐endocrine H&N neoplasms, 91.9% for thyroid pathology, 97.6% for parathyroid pathology, and 96.4% for benign lesions. Prediction of appointment urgency achieved a Matthews correlation coefficient of 0.698, reflecting strong predictive performance.

Conclusion

This novel NLP model demonstrated robust performance characteristics for predicting H&N diagnoses based on referring documents and excelled at identifying patients requiring urgent care based on malignancy risk. This tool may help H&N practice coordinators screen referrals, potentially optimizing patient care.

Subjects

MeSH terms (MEDLINE)

Natural Language ProcessingTriageHead and Neck NeoplasmsAppointments and SchedulesHumansRetrospective StudiesFemaleMaleMiddle AgedAgedAdultReferral and Consultation

Author keywords

appointmentdeep learninghead and neck cancernatural language processingreferraltriaging

Authors and institutions

  • Department of Otolaryngology-Head and Neck Surgery, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA.
  • Department of Radiology, University of California Irvine, Irvine, California, USA.
  • IIAM Corporation, San Francisco, California, USA.
  • Department of Bioengineering, Stanford University, Stanford, California, USA.
  • Department of Otolaryngology-Head and Neck Surgery, University of California San Francisco, San Francisco, California, USA.

ORCID profiles: Andy S Ding, Nicole T Jiam

Funding

  • National Science Foundation

Cite

APA

Seo, S., Ding, A. S., Ahmad, S. A., Xin, K. Z., Jiam, M. L., Xin, V., Mady, L. J., Gourin, C. G., Mydlarz, W. K., London, N. R., Koch, W., Fakhry, C., & Jiam, N. T. (2025). A Novel Natural Language Processing Model for Triaging Head and Neck Patient Appointments. Otolaryngology–Head and Neck Surgery, 173(1), 126-133. https://doi.org/10.1002/ohn.1244

Vancouver

Seo S, Ding AS, Ahmad SA, Xin KZ, Jiam ML, Xin V, et al. A Novel Natural Language Processing Model for Triaging Head and Neck Patient Appointments. Otolaryngology–Head and Neck Surgery. 2025;173(1):126-133. doi:10.1002/ohn.1244

BibTeX
@article{Seo2025,
  author = {Seo, Stefanie and Ding, Andy S and Ahmad, Syed Ameen and Xin, Kevin Z and Jiam, Max L and Xin, Vincent and Mady, Leila J and Gourin, Christine G and Mydlarz, Wojciech K and London, Nyall R and Koch, Wayne and Fakhry, Carole and Jiam, Nicole T},
  title = {A Novel Natural Language Processing Model for Triaging Head and Neck Patient Appointments},
  journal = {Otolaryngology–Head and Neck Surgery},
  year = {2025},
  volume = {173},
  number = {1},
  pages = {126--133},
  doi = {10.1002/ohn.1244}
}
Start for free →