Large language model-based extraction of rheumatoid arthritis clinical disease activity index from clinical notes
JAMIA Open · 07.07.2026 · 9 (4)
DOI: 10.1093/jamiaopen/ooag152 ↗Kurz gefasst
Fachartikel in der Zeitschrift JAMIA Open, online erschienen am 30.07.2026. Verfasst von Reid Weisberg und 7 weiteren Autor:innen. Beteiligte Einrichtung: Division of Rheumatology, Department of Medicine, UT Southwestern Medical Center, Dallas, TX 10032, United States. Die Arbeit nennt 19 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: NCATS NIH HHS, Columbia Irving Institute for Clinical and Translational Research Training KL2 Mentored Career Development.
Abstract (Originalsprache)
Objectives
We extracted a validated disease activity measure in rheumatoid arthritis (RA), the Clinical Disease Activity Index (CDAI), from a large tertiary academic medical center electronic health record (EHR) using an automated large language model (LLM)-based approach without requiring model pretraining. Materials and Methods The New York Presbyterian/Columbia University Medical Center Clinical Data Warehouse contains EHR data for over 4.5 million patients. RA patients were identified using International Classification of Disease-9 (ICD-9) and ICD-10 codes. Expert-curated CDAI keywords were extracted from unstructured notes using an automated natural language processing (NLP) pipeline leveraging GPT-4o API, a HIPAA-compliant, institutionally approved LLM platform. Performance was evaluated against expert chart review.
Results
Among 2756 RA patients with notes, 1038 (37.7%) were seropositive, 796 (28.9%) were seronegative, and 922 (33.4%) had unknown serostatus. Clinical Disease Activity Index and its components were extracted in 15.4% (160/1038) of seropositive patients indicating remission or low disease activity. Clinical Disease Activity Index documentation was more frequent among patients with multiple notes and among faculty, with high extraction accuracy (precision/recall/F1 = 0.97).
Discussion
This represents the first attempt to employ a zero-shot, ChatGPT-powered LLM platform to extract RA disease activity measures from real-world EHR data. Although a low prevalence of documentation was noted, important distinctions were observed when patients were subgrouped by serostatus, level of training, and number of visits.
Conclusion
An LLM-based pipeline accurately extracted CDAI from a single large academic EHR, revealing infrequent real-world documentation.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Division of Rheumatology, Department of Medicine, UT Southwestern Medical Center, Dallas, TX 10032, United States.
- Data Science Institute, Columbia University, New York, NY 10027, United States.
- Columbia University Vagelos College of Physicians & Surgeons, New York, NY 10032, United States.
- Division of Rheumatology, Department of Medicine, Columbia University Medical Center, New York, NY 10032, United States.
- Division of Rheumatology, Kao Autoimmunity Institute, Cedars-Sinai Medical Center, Los Angeles, CA 90048, United States.
- Department of Biomedical Informatics, Columbia University, New York, NY 10032, United States.
ORCID-Profile: Jon T Giles, Chunhua Weng, Elizabeth Park
Förderung
- NCATS NIH HHS
- Columbia Irving Institute for Clinical and Translational Research Training KL2 Mentored Career Development
Zitieren
APA
Weisberg, R., Yang, R., Kamdar, I., Chestang, J., Bathon, J., Giles, J. T., Weng, C., & Park, E. (2026). Large language model-based extraction of rheumatoid arthritis clinical disease activity index from clinical notes. JAMIA Open, 9(4). https://doi.org/10.1093/jamiaopen/ooag152
Vancouver
Weisberg R, Yang R, Kamdar I, Chestang J, Bathon J, Giles JT, et al. Large language model-based extraction of rheumatoid arthritis clinical disease activity index from clinical notes. JAMIA Open. 2026;9(4). doi:10.1093/jamiaopen/ooag152
BibTeX
@article{Weisberg2026,
author = {Weisberg, Reid and Yang, Ruoqi and Kamdar, Iram and Chestang, Justin and Bathon, Joan and Giles, Jon T and Weng, Chunhua and Park, Elizabeth},
title = {Large language model-based extraction of rheumatoid arthritis clinical disease activity index from clinical notes},
journal = {JAMIA Open},
year = {2026},
volume = {9},
number = {4},
doi = {10.1093/jamiaopen/ooag152}
}
EUVIMED