Develop and validate a fair machine learning model to identify patients with high data-continuity in electronic health records data
JAMIA Open · 07.07.2026 · 9 (4)
DOI: 10.1093/jamiaopen/ooag124 ↗Kurz gefasst
Fachartikel in der Zeitschrift JAMIA Open, online erschienen am 13.07.2026. Verfasst von Yao An Lee und 5 weiteren Autor:innen. Beteiligte Einrichtung: Center for Biomedical Informatics, Regenstrief Institute, Indianapolis, IN 46202, United States. Die Arbeit nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIA NIH HHS, NIDDK NIH HHS, National Institutes of Health, National Institute of Diabetes and Digestive and Kidney Diseases.
Abstract (Originalsprache)
Objectives
Electronic health record (EHR) data discontinuity, defined as receiving care outside of a particular EHR system, may cause misclassification of study variables. We aimed to: (1) quantify misclassification across levels of EHR data discontinuity and identify an optimal continuity threshold, (2) develop a machine learning (ML) model to predict EHR continuity and optimize fairness across racial and ethnic groups, and (3) externally validate the EHR continuity prediction model using an independent dataset. Materials and Methods We used linked OneFlorida+ EHR-Medicaid claims data for model development and Research Action for Health Network (REACHnet) EHR-Louisiana Blue Cross Blue Shield (LABlue) claims data for external validation. A Harmonized Encounter Proportion Score (HEPS), adapted from prior continuity metrics, was applied to quantify patient-level EHR data continuity and the impact on misclassification of 42 clinical variables. Machine learning models were trained using routinely available demographic, clinical, and healthcare utilization features derived from structured EHR data.
Results
Higher EHR data continuity was associated with lower rates of misclassification. A HEPS threshold of approximately 30% effectively distinguished patients with sufficient data continuity. Machine learning models demonstrated strong performance in predicting high continuity (area under the receiver operating characteristic curve [AUROC] = 0.77). Fairness assessments showed bias against Hispanic group, which was substantially improved following bias mitigation procedures. Model performance remained robust and fair in the external validation.
Discussion
Our study offers a practical metric for quantifying data continuity in EHR networks. The current ML model incorporating EHR-routinely collected information can accurately identify patients with high care continuity.
Conclusions
We developed a generalizable data-continuity classification tool that can be easily applied across EHR systems, strengthening the rigor of EHR-based research.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Center for Biomedical Informatics, Regenstrief Institute, Indianapolis, IN 46202, United States.
- Department of Health Policy and Management, Celia Scott Weatherhead School of Public Health and Tropical Medicine, Tulane University, New Orleans, LA 70112, United States.
- Department of Biostatistics & Health Data Science, Indiana University, Indianapolis, IN 46202, United States.
- Center of Health Systems Analytics Research, Tulane University, New Orleans, LA 70112, United States.
- Department of Pharmacy Practice, Purdue University College of Pharmacy, Indianapolis, IN 46202, United States.
ORCID-Profile: Yao An Lee, Jiang Bian, Lizheng Shi
Förderung
- NIA NIH HHS
- NIDDK NIH HHS
- National Institutes of Health, National Institute of Diabetes and Digestive and Kidney Diseases
- National Institutes of Health, National Institute on Aging
Zitieren
APA
Lee, Y. A., Tang, T., Huang, Y., Bian, J., Shi, L., & Guo, J. (2026). Develop and validate a fair machine learning model to identify patients with high data-continuity in electronic health records data. JAMIA Open, 9(4). https://doi.org/10.1093/jamiaopen/ooag124
Vancouver
Lee YA, Tang T, Huang Y, Bian J, Shi L, Guo J. Develop and validate a fair machine learning model to identify patients with high data-continuity in electronic health records data. JAMIA Open. 2026;9(4). doi:10.1093/jamiaopen/ooag124
BibTeX
@article{Lee2026,
author = {Lee, Yao An and Tang, Tiange and Huang, Yu and Bian, Jiang and Shi, Lizheng and Guo, Jingchuan},
title = {Develop and validate a fair machine learning model to identify patients with high data-continuity in electronic health records data},
journal = {JAMIA Open},
year = {2026},
volume = {9},
number = {4},
doi = {10.1093/jamiaopen/ooag124}
}
EUVIMED