EUVIMEDEUVIMED entdecken
Open Access

Natural Language Processing Accurately Differentiates Cancer Symptom Information in Electronic Health Record Narratives

Alaa Albashayreh iD, Anindita Bandyopadhyay iD, Nahid Zeinali, Min Zhang, Weiguo Fan iD, Stephanie Gilbertson White iD

JCO Clinical Cancer Informatics · 2024

DOI: 10.1200/cci.23.00235 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JCO Clinical Cancer Informatics, 2024. Verfasst von Alaa Albashayreh und 5 weiteren Autor:innen. Beteiligte Einrichtung: College of Nursing, University of Iowa, Iowa City, IA. Hauptthemen laut MEDLINE: Natural Language Processing, Electronic Health Records, Neoplasms. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NINR NIH HHS, NCATS NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

PURPOSE Identifying cancer symptoms in electronic health record (EHR) narratives is feasible with natural language processing (NLP). However, more efficient NLP systems are needed to detect various symptoms and distinguish observed symptoms from negated symptoms and medication-related side effects. We evaluated the accuracy of NLP in (1) detecting 14 symptom groups (ie, pain, fatigue, swelling, depressed mood, anxiety, nausea/vomiting, pruritus, headache, shortness of breath, constipation, numbness/tingling, decreased appetite, impaired memory, disturbed sleep) and (2) distinguishing observed symptoms in EHR narratives among patients with cancer. METHODS We extracted 902,508 notes for 11,784 unique patients diagnosed with cancer and developed a gold standard corpus of 1,112 notes labeled for presence or absence of 14 symptom groups. We trained an embeddings-augmented NLP system integrating human and machine intelligence and conventional machine learning algorithms. NLP metrics were calculated on a gold standard corpus subset for testing. RESULTS The interannotator agreement for labeling the gold standard corpus was excellent at 92%. The embeddings-augmented NLP model achieved the best performance (F1 score = 0.877). The highest NLP accuracy was observed in pruritus (F1 score = 0.937) while the lowest accuracy was in swelling (F1 score = 0.787). After classifying the entire data set with embeddings-augmented NLP, we found that 41% of the notes included symptom documentation. Pain was the most documented symptom (29% of all notes) while impaired memory was the least documented (0.7% of all notes). CONCLUSION We illustrated the feasibility of detecting 14 symptom groups in EHR narratives and showed that an embeddings-augmented NLP system outperforms conventional machine learning algorithms in detecting symptom information and differentiating observed symptoms from negated symptoms and medication-related side effects.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Natural Language ProcessingElectronic Health RecordsNeoplasmsHumansFemaleMaleAlgorithmsMachine LearningNarrationMiddle Aged

Autor:innen und Institutionen

  • College of Nursing, University of Iowa, Iowa City, IA.
  • Tippie College of Business, University of Iowa, Iowa City, IA.
  • Graduate College, University of Iowa, Iowa City, IA.
  • School of Economics and Management, Communication University of China, Beijing, China.

ORCID-Profile: Alaa Albashayreh, Anindita Bandyopadhyay, Weiguo Fan, Stephanie Gilbertson White

Förderung

  • NINR NIH HHS
  • NCATS NIH HHS

Zitieren

APA

Albashayreh, A., Bandyopadhyay, A., Zeinali, N., Zhang, M., Fan, W., & Gilbertson White, S. (2024). Natural Language Processing Accurately Differentiates Cancer Symptom Information in Electronic Health Record Narratives. JCO Clinical Cancer Informatics. https://doi.org/10.1200/cci.23.00235

Vancouver

Albashayreh A, Bandyopadhyay A, Zeinali N, Zhang M, Fan W, Gilbertson White S. Natural Language Processing Accurately Differentiates Cancer Symptom Information in Electronic Health Record Narratives. JCO Clinical Cancer Informatics. 2024. doi:10.1200/cci.23.00235

BibTeX
@article{Albashayreh2024,
  author = {Albashayreh, Alaa and Bandyopadhyay, Anindita and Zeinali, Nahid and Zhang, Min and Fan, Weiguo and Gilbertson White, Stephanie},
  title = {Natural Language Processing Accurately Differentiates Cancer Symptom Information in Electronic Health Record Narratives},
  journal = {JCO Clinical Cancer Informatics},
  year = {2024},
  doi = {10.1200/cci.23.00235}
}
Kostenlos starten →