EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

A Scalable Method for Validated Data Extraction from Electronic Health Records with Large Language Models

Timothy J. Stuhlmiller, AJ Rabe, Jeff Rapp, Alaa Awawda, Hiba Kouser, Kristi Lui, Hugh Salamon, Donald Chuyka, William Mahoney, John M. Furgason, Madhuri Paul, Frank J. Scarpa und 5 weitere

AI in Precision Oncology · 01.12.2026 · 3 (6) · 171-182

DOI: 10.1177/2993091x261492372 ↗

Kurz gefasst

Fachartikel in der Zeitschrift AI in Precision Oncology, online erschienen am 29.09.2026. Verfasst von Timothy J. Stuhlmiller und 16 weiteren Autor:innen. Die Arbeit nennt 16 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose/Background: Health care organizations increasingly require structured, patient-level clinical variables for treatment decisions, operational workflows, quality measurement, and clinical trial screening. Relevant information is often fragmented across heterogeneous electronic health record (EHR) systems, unstructured formats, and scanned documents. Large language models (LLMs) offer an opportunity to enhance medical record extraction, particularly in oncology where point-of-care structured coding rarely captures a patient’s full longitudinal clinical course.

Methods

Two complementary LLM-based approaches were developed. The first performed schema-based Named Entity Recognition and Relation Extraction from unstructured documents, normalizing outputs to Fast Healthcare Interoperability Resources and Observational Health Data Sciences and Informatics vocabularies. The second used a retrieval-augmented checklist framework that queried embedded document text alongside structured data, returning custom outputs with evidence-based justifications and source citations. Performance was evaluated through human validation, automated consistency checks, and iterative error analysis.

Results

Schema-based LLM extractors for medications, radiation, and surgical procedures achieved ∼95% accuracy, precision, recall, and F1. Deployed across 3,493 patients, LLM extraction yielded a 207% increase in distinct oncology drug ingredients over structured EHR sources. Oncology therapies were captured for 65% of patients versus 40% in structured data, with dramatically improved attribute coverage: indication for prescription (71% vs. 5%) and reason for discontinuation (10% vs. 0%). For radiation and oncology surgical procedures, LLM extraction yielded more than triple the patient coverage versus structured sources. The checklist framework achieved strong F1 scores in extracting cancer diagnosis variables (99.0%) and lines of therapy (97.6%) across 4,802 validated elements. Cancer diagnoses and dates were identified for 93.5% of patients versus 69.8% in structured data; stage and grade were extracted for 64% and 62% versus near-zero structured availability. A lines-of-therapy checklist generated 4,218 treatment lines across 2,320 patients, capturing regimen dates, best response, discontinuation reasons, and progression dates. Among patients with response data, objective response rate declined from 65% at first line to 22% at third line, with first-line response rates ranging from 43% in colorectal to 85% in esophageal cancer.

Conclusions

Two complementary LLM-based strategies substantially enhanced the completeness and utility of structured clinical data from heterogeneous medical records, supporting scalable generation of interoperable patient-level datasets for clinical analytics, research, and operational workflows.

Zitieren

APA

Stuhlmiller, T. J., Rabe, A., Rapp, J., Awawda, A., Kouser, H., Lui, K., Salamon, H., Chuyka, D., Mahoney, W., Furgason, J. M., Paul, M., Scarpa, F. J., Kesari, S., Newton, M. E., Wong, K. K., Kramer, G. A., & Shapiro, M. A. (2026). A Scalable Method for Validated Data Extraction from Electronic Health Records with Large Language Models. AI in Precision Oncology, 3(6), 171-182. https://doi.org/10.1177/2993091x261492372

Vancouver

Stuhlmiller TJ, Rabe A, Rapp J, Awawda A, Kouser H, Lui K, et al. A Scalable Method for Validated Data Extraction from Electronic Health Records with Large Language Models. AI in Precision Oncology. 2026;3(6):171-182. doi:10.1177/2993091x261492372

BibTeX
@article{Stuhlmiller2026,
  author = {Stuhlmiller, Timothy J. and Rabe, AJ and Rapp, Jeff and Awawda, Alaa and Kouser, Hiba and Lui, Kristi and Salamon, Hugh and Chuyka, Donald and Mahoney, William and Furgason, John M. and Paul, Madhuri and Scarpa, Frank J. and Kesari, Santosh and Newton, Mika E. and Wong, Kenny K. and Kramer, Glenn A. and Shapiro, Mark A.},
  title = {A Scalable Method for Validated Data Extraction from Electronic Health Records with Large Language Models},
  journal = {AI in Precision Oncology},
  year = {2026},
  volume = {3},
  number = {6},
  pages = {171--182},
  doi = {10.1177/2993091x261492372}
}
Kostenlos starten →