EUVIMEDAtrasti EUVIMED
ValidierungsstudieOpen access

Assessing Total Hip Arthroplasty Outcomes and Generating an Orthopedic Research Outcome Database via a Natural Language Processing Pipeline: Development and Validation Study

Nicholas H Mast iD, Clara L Oeste iD, Dries Hens iD

JMIR Medical Informatics · 2025

DOI: 10.2196/64705 ↗

At a glance

Validierungsstudie in JMIR Medical Informatics, 2025. Written by Nicholas H Mast and 2 co-authors. Institution: Hip and Pelvis Institute, 2250 Hayes St # 208, San Francisco, CA, 94117, United States, 1 415-530-5330. Major MEDLINE topics: Arthroplasty, Replacement, Hip, Natural Language Processing, Databases, Factual. Cited 4 times so far (Crossref); 20 references. The full text is freely available in PubMed Central.

SantraukaSubjectsBibliografiniai duomenysCiteRelated studies

Abstract (original language)

Background

Processing data from electronic health records (EHRs) to build research-grade databases is a lengthy and expensive process. Modern arthroplasty practice commonly uses multiple sites of care, including clinics and ambulatory care centers. However, most private data systems prevent obtaining usable insights for clinical practice.

Objective

This study aims to create an automated natural language processing (NLP) pipeline for extracting clinical concepts from EHRs related to orthopedic outpatient visits, hospitalizations, and surgeries in a multicenter, single-surgeon practice. The pipeline was also used to assess therapies and complications after total hip arthroplasty (THA).

Methods

EHRs of 1290 patients undergoing primary THA from January 1, 2012 to December 31, 2019 (operated and followed by the same surgeon) were processed using artificial intelligence (AI)–based models (NLP and machine learning). In addition, 3 independent medical reviewers generated a gold standard using 100 randomly selected EHRs. The algorithm processed the entire database from different EHR systems, generating an aggregated clinical data warehouse. An additional manual control arm was used for data quality control.

Results

The algorithm was as accurate as human reviewers (0.95 vs 0.94; P= .01), achieving a database-wide average F 1 -score of 0.92 (SD 0.09; range 0.67‐0.99), validating its use as an automated data extraction tool. During the first year after direct anterior THA, 92.1% (1188/1290) of our population had a complication-free recovery. In 7.9% (102/1290) of cases where surgery or recovery was not uneventful, lateral femoral cutaneous nerve sensitivity (47/1290, 3.6%), intraoperative fractures (13/1290, 1%), and hematoma (9/1290, 0.7%) were the most common complications.

Conclusions

Algorithm evaluation of this dataset accurately represented key clinical information swiftly, compared with human reviewers. This technology may provide substantial value for future surgeon practice and patient counseling. Furthermore, the low early complication rate of direct anterior THA in this surgeon’s hands was supported by the dataset, which included data from all treated patients in a multicenter practice.

Subjects

MeSH terms (MEDLINE)

Arthroplasty, Replacement, HipNatural Language ProcessingDatabases, FactualHumansElectronic Health RecordsFemaleMaleMiddle AgedAgedAlgorithmsMachine Learning

Author keywords

EHRNLPTHAcomplication ratedirect anterior approachelectronic health recordship arthroplastyhospitalizationsnatural language processingorthopedicoutpatient visitssingle-surgeon registrysurgeonsurgerytotal hip arthroplasty

Authors and institutions

  • Hip and Pelvis Institute, 2250 Hayes St # 208, San Francisco, CA, 94117, United States, 1 415-530-5330.
  • LynxCare Inc, Leuven, Belgium.

ORCID profiles: Nicholas H Mast, Clara L Oeste, Dries Hens

Cite

APA

Mast, N. H., Oeste, C. L., & Hens, D. (2025). Assessing Total Hip Arthroplasty Outcomes and Generating an Orthopedic Research Outcome Database via a Natural Language Processing Pipeline: Development and Validation Study. JMIR Medical Informatics. https://doi.org/10.2196/64705

Vancouver

Mast NH, Oeste CL, Hens D. Assessing Total Hip Arthroplasty Outcomes and Generating an Orthopedic Research Outcome Database via a Natural Language Processing Pipeline: Development and Validation Study. JMIR Medical Informatics. 2025. doi:10.2196/64705

BibTeX
@article{Mast2025,
  author = {Mast, Nicholas H and Oeste, Clara L and Hens, Dries},
  title = {Assessing Total Hip Arthroplasty Outcomes and Generating an Orthopedic Research Outcome Database via a Natural Language Processing Pipeline: Development and Validation Study},
  journal = {JMIR Medical Informatics},
  year = {2025},
  doi = {10.2196/64705}
}
Start for free →