Reporting Quality of AI Intervention in Randomized Controlled Trials in Primary Care: Systematic Review and Meta-Epidemiological Study
Journal of Medical Internet Research · 25.02.2025 · 27 · e56774
DOI: 10.2196/56774 ↗Kurz gefasst
Systematische Übersicht in der Zeitschrift Journal of Medical Internet Research, online erschienen am 25.02.2025. Verfasst von Jinjia Zhong und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of General Practice and Continuing Education, Capital Medical University, Beijing, China. Hauptthemen laut MEDLINE: Primary Health Care, Randomized Controlled Trials as Topic, Artificial Intelligence. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
The surge in artificial intelligence (AI) interventions in primary care trials lacks a study on reporting quality.
Objective
This study aimed to systematically evaluate the reporting quality of both published randomized controlled trials (RCTs) and protocols for RCTs that investigated AI interventions in primary care.
Methods
PubMed, Embase, Cochrane Library, MEDLINE, Web of Science, and CINAHL databases were searched for RCTs and protocols on AI interventions in primary care until November 2024. Eligible studies were published RCTs or full protocols for RCTs exploring AI interventions in primary care. The reporting quality was assessed using CONSORT-AI (Consolidated Standards of Reporting Trials–Artificial Intelligence) and SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials–Artificial Intelligence) checklists, focusing on AI intervention–related items.
Results
A total of 11,711 records were identified. In total, 19 published RCTs and 21 RCT protocols for 35 trials were included. The overall proportion of adequately reported items was 65% (172/266; 95% CI 59%-70%) and 68% (214/315; 95% CI 62%-73%) for RCTs and protocols, respectively. The percentage of RCTs and protocols that reported a specific item ranged from 11% (2/19) to 100% (19/19) and from 10% (2/21) to 100% (21/21), respectively. The reporting of both RCTs and protocols exhibited similar characteristics and trends. They both lack transparency and completeness, which can be summarized in three aspects: without providing adequate information regarding the input data, without mentioning the methods for identifying and analyzing performance errors, and without stating whether and how the AI intervention and its code can be accessed.
Conclusions
The reporting quality could be improved in both RCTs and protocols. This study helps promote the transparent and complete reporting of trials with AI interventions in primary care.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of General Practice and Continuing Education, Capital Medical University, Beijing, China.
ORCID-Profile: Jinjia Zhong, Ting Zhu, Yafang Huang
Zitieren
APA
Zhong, J., Zhu, T., & Huang, Y. (2025). Reporting Quality of AI Intervention in Randomized Controlled Trials in Primary Care: Systematic Review and Meta-Epidemiological Study. Journal of Medical Internet Research, 27, e56774. https://doi.org/10.2196/56774
Vancouver
Zhong J, Zhu T, Huang Y. Reporting Quality of AI Intervention in Randomized Controlled Trials in Primary Care: Systematic Review and Meta-Epidemiological Study. Journal of Medical Internet Research. 2025;27:e56774. doi:10.2196/56774
BibTeX
@article{Zhong2025,
author = {Zhong, Jinjia and Zhu, Ting and Huang, Yafang},
title = {Reporting Quality of AI Intervention in Randomized Controlled Trials in Primary Care: Systematic Review and Meta-Epidemiological Study},
journal = {Journal of Medical Internet Research},
year = {2025},
volume = {27},
pages = {e56774},
doi = {10.2196/56774}
}
EUVIMED