EUVIMEDEUVIMED entdecken
Open Access

Identifying Patient-Reported Outcome Measure Documentation in Veterans Health Administration Chiropractic Clinic Notes: Natural Language Processing Analysis

Brian C Coleman iD, Kelsey L Corcoran iD, Cynthia A Brandt iD, Joseph L Goulet iD, Stephen L Luther iD, Anthony J Lisi iD

JMIR Medical Informatics · 2025

DOI: 10.2196/66466 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JMIR Medical Informatics, 2025. Verfasst von Brian C Coleman und 5 weiteren Autor:innen. Beteiligte Einrichtung: Pain Research, Informatics, Multimorbidities, and Education Center, VA Connecticut Healthcare System, 950 Campbell Ave, West Haven, CT, 06516, United…. Hauptthemen laut MEDLINE: Natural Language Processing, Patient Reported Outcome Measures, Documentation, Electronic Health Records. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NCCIH NIH HHS, Department of Veterans Affairs, Veterans Health Administration, Office of Research and Development,.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

The use of patient-reported outcome measures (PROMs) is an expected component of high-quality, measurement-based chiropractic care. The largest health care system offering integrated chiropractic care is the Veterans Health Administration (VHA). Challenges limit monitoring PROM use as a care quality metric at a national scale in the VHA. Structured data are unavailable, with PROMs often embedded within clinic text notes as unstructured data requiring time-intensive, peer-conducted chart review for evaluation. Natural language processing (NLP) of clinic text notes is one promising solution to extracting care quality data from unstructured text.

Objective

This study aims to test NLP approaches to identify PROMs documented in VHA chiropractic text notes.

Methods

VHA chiropractic notes from October 1, 2017, to September 30, 2020, were obtained from the VHA Musculoskeletal Diagnosis/Complementary and Integrative Health Cohort. A rule-based NLP model built using medspaCy and spaCy was evaluated on text matching and note categorization tasks. SpaCy was used to build bag-of-words, convoluted neural networks, and ensemble models for note categorization. Performance metrics for each model and task included precision, recall, and F-measure. Cross-validation was used to validate performance metric estimates for the statistical and machine-learning models.

Results

Our sample included 377,213 visit notes from 56,628 patients. The rule-based model performance was good for soft-boundary text-matching (precision=81.1%, recall=96.7%, and F-measure=88.2%) and excellent for note categorization (precision=90.3%, recall=99.5%, and F-measure=94.7%). Cross-validation performance of the statistical and machine learning models for the note categorization task was very good overall, but lower than rule-based model performance. The overall prevalence of PROM documentation was low (17.0%).

Conclusions

We evaluated multiple NLP methods across a series of tasks, with optimal performance achieved using a rule-based method. By leveraging NLP approaches, we can overcome the challenges posed by unstructured clinical text notes to track documented PROM use. Overall documented use of PROMs in chiropractic notes was low and highlights a potential for quality improvement. This work represents a methodological advancement in the identification and monitoring of documented use of PROMs to ensure consistent, high-quality chiropractic care for veterans.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Natural Language ProcessingPatient Reported Outcome MeasuresDocumentationElectronic Health RecordsChiropracticHumansUnited StatesUnited States Department of Veterans AffairsMale

Stichwörter der Autor:innen

AINLPPROMVeterans Health Administrationartificial intelligencecarechiropracticchiropractic carechiropractorintegrated health cohortmusculoskeletalmusculoskeletal diagnosisnatural language processingneural networkpatient reported outcome measures

Autor:innen und Institutionen

  • Pain Research, Informatics, Multimorbidities, and Education Center, VA Connecticut Healthcare System, 950 Campbell Ave, West Haven, CT, 06516, United States, 1 2039325711.
  • Department of Emergency Medicine, Yale School of Medicine, Yale University, New Haven, CT, United States.
  • Department of Biomedical Informatics and Data Science, Yale School of Medicine, Yale University, New Haven, CT, United States.
  • Center of Innovation for Complex Chronic Healthcare, Edward Hines, Jr. VA Hospital, Hines, IL, United States.
  • College of Public Health, University of South Florida, Tampa, FL, United States.

ORCID-Profile: Brian C Coleman, Kelsey L Corcoran, Cynthia A Brandt, Joseph L Goulet, Stephen L Luther, Anthony J Lisi

Förderung

  • NCCIH NIH HHS
  • Department of Veterans Affairs, Veterans Health Administration, Office of Research and Development,

Zitieren

APA

Coleman, B. C., Corcoran, K. L., Brandt, C. A., Goulet, J. L., Luther, S. L., & Lisi, A. J. (2025). Identifying Patient-Reported Outcome Measure Documentation in Veterans Health Administration Chiropractic Clinic Notes: Natural Language Processing Analysis. JMIR Medical Informatics. https://doi.org/10.2196/66466

Vancouver

Coleman BC, Corcoran KL, Brandt CA, Goulet JL, Luther SL, Lisi AJ. Identifying Patient-Reported Outcome Measure Documentation in Veterans Health Administration Chiropractic Clinic Notes: Natural Language Processing Analysis. JMIR Medical Informatics. 2025. doi:10.2196/66466

BibTeX
@article{Coleman2025,
  author = {Coleman, Brian C and Corcoran, Kelsey L and Brandt, Cynthia A and Goulet, Joseph L and Luther, Stephen L and Lisi, Anthony J},
  title = {Identifying Patient-Reported Outcome Measure Documentation in Veterans Health Administration Chiropractic Clinic Notes: Natural Language Processing Analysis},
  journal = {JMIR Medical Informatics},
  year = {2025},
  doi = {10.2196/66466}
}
Kostenlos starten →