The Phases of Living Evidence Synthesis Using AI: Living Evidence Synthesis (Version 1)
Journal of Medical Internet Research · 2026-01-27 · 28 · e76130-e76130
DOI: 10.2196/76130 ↗At a glance
Journal article in Journal of Medical Internet Research, published online on 2026-01-27. Written by Xuping Song and 14 co-authors. Institution: School of Public Health, Lanzhou University, No. 222 South Tianshui Road, Lanzhou, Lanzhou, Gansu, 753000, China, +86 13893117077, +86 13893117077. Major MEDLINE topics: Artificial Intelligence. Cited 5 times so far (Crossref); 94 references. The full text is freely available in PubMed Central.
Abstract (original language)
Background
Living evidence (LE) synthesis refers to the method of continuously updating systematic evidence reviews to incorporate new evidence. It has emerged to address the limitations of the traditional systematic review process, particularly the absence of or delays in publication updates. The emergence of COVID-19 accelerated the progress in the field of LE synthesis, and currently, the applications of artificial intelligence (AI) in LE synthesis are expanding rapidly. However, in which phases of LE synthesis should AI be used remains an unanswered question.
Objective
This study aims to (1) document the phases of LE synthesis where AI is used and (2) investigate whether AI improves the efficiency, accuracy, or utility of LE synthesis.
Methods
We searched Web of Science, PubMed, the Cochrane Library, Epistemonikos, the Campbell Library, IEEE Xplore, medRxiv, COVID-19 Evidence Network to support Decision-making, and McMaster Health Forum. We used Covidence to facilitate the monthly screening and extraction processes to maintain the LE synthesis process. Studies that used or developed AI or semiautomated tools in the phases of LE synthesis were included.
Results
A total of 24 studies were included, including 17 on LE syntheses, with 4 involving tool development, and 7 on living meta-analyses, with 3 involving tool development. First, a total of 34 AI or semiautomated tools were involved, comprising 12 AI tools and 22 semiautomated tools. The most frequently used AI or semiautomated tools were machine learning classifiers (n=5) and the Living Interactive Evidence synthesis platform (n=3). Second, 20 AI or semiautomated tools were used for the data extraction or collection and risk of bias assessment phase, and only 1 AI tool was used for the publication update phase. Third, 3 studies demonstrated the improvement in efficiency achieved based on time, workload, and conflict rate metrics. Nine studies applied AI or semiautomated tools in LE synthesis, obtaining a mean recall rate of 96.24%, and 6 studies achieved a mean F 1 -score of 92.17%. Additionally, 8 studies reported precision values ranging from 0.2% to 100%.
Conclusions
AI and semiautomated tools primarily facilitate data extraction or collection and risk of bias assessment. The use of AI or semiautomated tools in LE synthesis improves efficiency, leading to high accuracy, recall, and F 1 -scores, while precision varies across tools.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- School of Public Health, Lanzhou University, No. 222 South Tianshui Road, Lanzhou, Lanzhou, Gansu, 753000, China, +86 13893117077, +86 13893117077.
- The Centre of Evidence-based Social Science, Lanzhou University, Lanzhou, Gansu, China.
- Key Laboratory of Evidence Based Medicine & Knowledge Translation of Gansu Province, Lanzhou, Gansu, China.
- WHO Collaborating Centre for Guideline Implementation and Knowledge Translation, Lanzhou, Gansu, China.
- Dingxi Center for Disease Control and Prevention, Dingxi, Gansu, China.
- Evidence-Based Medicine Center, School of Basic Medicine, Lanzhou University, Lanzhou, Gansu, China.
Cite
APA
Song, X., Lian, Z., Wang, R., Li, R., Yang, Z., Luo, X., Feng, L., Ma, Z., Pu, Z., Wang, Q., Ge, L., Li, C., Chen, Y., Yang, K., & Lavis, J. (2026). The Phases of Living Evidence Synthesis Using AI: Living Evidence Synthesis (Version 1). Journal of Medical Internet Research, 28, e76130-e76130. https://doi.org/10.2196/76130
Vancouver
Song X, Lian Z, Wang R, Li R, Yang Z, Luo X, et al. The Phases of Living Evidence Synthesis Using AI: Living Evidence Synthesis (Version 1). Journal of Medical Internet Research. 2026;28:e76130-e76130. doi:10.2196/76130
BibTeX
@article{Song2026,
author = {Song, Xuping and Lian, Zhenjie and Wang, Rui and Li, Ruixin and Yang, Zhenzhen and Luo, Xufei and Feng, Lei and Ma, Zhiming and Pu, Zhen and Wang, Qi and Ge, Long and Li, Caihong and Chen, Yaolong and Yang, Kehu and Lavis, John},
title = {The Phases of Living Evidence Synthesis Using AI: Living Evidence Synthesis (Version 1)},
journal = {Journal of Medical Internet Research},
year = {2026},
volume = {28},
pages = {e76130--e76130},
doi = {10.2196/76130}
}
EUVIMED