Diagnostic Prediction Models for Primary Care, Based on AI and Electronic Health Records: Systematic Review
JMIR Medical Informatics · 2025-08-22 · 13 · e62862-e62862
DOI: 10.2196/62862 ↗At a glance
Systematische Übersicht in JMIR Medical Informatics, published online on 2025-08-22. Written by Liesbeth Hunik and 7 co-authors. Institution: Department of Primary and Community Care, Research Institute for Medical Innovation, Radboudumc, Geert Grooteplein Zuid 21, Nijmegen, 6525 GA, The Ne…. Major MEDLINE topics: Electronic Health Records, Primary Health Care, Artificial Intelligence. Cited 16 times so far (Crossref); 82 references. The full text is freely available in PubMed Central.
Abstract (original language)
Background
Artificial intelligence (AI)–based diagnostic prediction models could aid primary care (PC) in decision-making for faster and more accurate diagnoses. AI has the potential to transform electronic health records (EHRs) data into valuable diagnostic prediction models. Different prediction models based on EHR have been developed. However, there are currently no systematic reviews that evaluate AI-based diagnostic prediction models for PC using EHR data.
Objective
This study aims to evaluate the content of diagnostic prediction models based on AI and EHRs in PC, including risk of bias and applicability.
Methods
This systematic review was performed according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. MEDLINE, Embase, Web of Science, and Cochrane were searched. We included observational and intervention studies using AI and PC EHRs and developing or testing a diagnostic prediction model for health conditions. Two independent reviewers (LH and AC) used a standardized data extraction form. Risk of bias and applicability were assessed using PROBAST (Prediction Model Risk of Bias Assessment Tool).
Results
From 10,657 retrieved records, a total of 15 papers were selected. Most EHR papers focused on 1 chronic health care condition (n=11, 73%). From the 15 papers, 13 (87%) described a study that developed a diagnostic prediction model and 2 (13%) described a study that externally validated and tested the model in a PC setting. Studies used a variety of AI techniques. The predictors used to develop the model were all registered in the EHR. We found no papers with a low risk of bias, and high risk of bias was found in 9 (60%) papers. Biases covered an unjustified small sample size, not excluding predictors from the outcome definition, and the inappropriate evaluation of the performance measures. The risk of bias was unclear in 6 papers, as no information was provided on the handling of missing data and no results were reported from the multivariate analysis. Applicability was unclear in 10 (67%) papers, mainly due to lack of clarity in reporting the time interval between outcomes and predictors.
Conclusions
Most AI-based diagnostic prediction models based on EHR data in PC focused on 1 chronic condition. Only 2 papers tested the model in a PC setting. The lack of sufficiently described methods led to a high risk of bias. Our findings highlight that the currently available diagnostic prediction models are not yet ready for clinical implementation in PC.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Department of Primary and Community Care, Research Institute for Medical Innovation, Radboudumc, Geert Grooteplein Zuid 21, Nijmegen, 6525 GA, The Netherlands, 31 243618181.
- Institute for Computing and Information Science, Radboud University, Nijmegen, The Netherlands.
- Department of Family Medicine, Care and Public Health Research Institute, Maastricht University, Maastricht, The Netherlands.
ORCID profiles: Liesbeth Hunik, Asma Chaabouni, Twan van Laarhoven, Tim C Olde Hartman, Ralph T H Leijenaar, Jochen W L Cals, Annemarie A Uijen, Henk J Schers
Cite
APA
Hunik, L., Chaabouni, A., van Laarhoven, T., Olde Hartman, T. C., Leijenaar, R. T. H., Cals, J. W. L., Uijen, A. A., & Schers, H. J. (2025). Diagnostic Prediction Models for Primary Care, Based on AI and Electronic Health Records: Systematic Review. JMIR Medical Informatics, 13, e62862-e62862. https://doi.org/10.2196/62862
Vancouver
Hunik L, Chaabouni A, van Laarhoven T, Olde Hartman TC, Leijenaar RTH, Cals JWL, et al. Diagnostic Prediction Models for Primary Care, Based on AI and Electronic Health Records: Systematic Review. JMIR Medical Informatics. 2025;13:e62862-e62862. doi:10.2196/62862
BibTeX
@article{Hunik2025,
author = {Hunik, Liesbeth and Chaabouni, Asma and van Laarhoven, Twan and Olde Hartman, Tim C and Leijenaar, Ralph T H and Cals, Jochen W L and Uijen, Annemarie A and Schers, Henk J},
title = {Diagnostic Prediction Models for Primary Care, Based on AI and Electronic Health Records: Systematic Review},
journal = {JMIR Medical Informatics},
year = {2025},
volume = {13},
pages = {e62862--e62862},
doi = {10.2196/62862}
}
EUVIMED