EUVIMEDEUVIMED entdecken
Open Access

Transparent Reporting of AI in Systematic Literature Reviews: Development of the PRISMA-trAIce Checklist

Dirk Holst, Keno Moenck, Julian Koch, Ole Schmedemann, Thorsten Schüppstuhl

JMIR AI · 10.12.2025 · 4 · e80247-e80247

DOI: 10.2196/80247 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JMIR AI, online erschienen am 10.12.2025. Verfasst von Dirk Holst und 4 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Aircraft Production Technology, Hamburg University of Technology, Am Schwarzenberg-Campus 1, Hamburg, 21073, Germany, 49 17689103318, 49…. Die Arbeit wurde bisher 49-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Systematic literature reviews (SLRs) build the foundation for evidence synthesis, but they are exceptionally demanding in terms of time and resources. While recent advances in artificial intelligence (AI), particularly large language models, offer the potential to accelerate this process, their use introduces challenges to transparency and reproducibility. Reporting guidelines such as the PRISMA-AI (Preferred Reporting Items for Systematic Reviews and Meta-Analyses–Artificial Intelligence Extension) primarily focus on AI as a subject of research, not as a tool in the review process itself.

Objective

To address the gap in reporting standards, this study aimed to develop and propose a discipline-agnostic checklist extension to the PRISMA 2020 statement. The goal was to ensure transparent reporting when AI is used as a methodological tool in evidence synthesis, fostering trust in the next generation of SLRs.

Methods

The proposed checklist, named PRISMA-trAIce (PRISMA–Transparent Reporting of Artificial Intelligence in Comprehensive Evidence Synthesis), was developed through a systematic process. We conducted a literature search to identify established, consensus-based AI reporting guidelines (eg, CONSORT-AI [Consolidated Standards of Reporting Trials–Artificial Intelligence] and TRIPOD-AI [Transparent Reporting of a Multivariable Prediction Model of Individual Prognosis or Diagnosis–Artificial Intelligence]). Relevant items from these frameworks were extracted, analyzed, and thematically synthesized to form a modular checklist that integrated with the PRISMA 2020 structure.

Results

The primary result of this work is the PRISMA-trAIce checklist, a comprehensive set of reporting items designed to document the use of AI in SLRs. The checklist covers the entire structure of an SLR, from title and abstract to methods and discussion, and includes specific items for identifying AI tools, describing human-AI interaction, reporting performance evaluation, and discussing limitations.

Conclusions

PRISMA-trAIce establishes an important framework to improve the transparency and methodological integrity of AI-assisted systematic reviews, enhancing the trust required for the responsible application of AI-assisted systematic reviews in evidence synthesis. We present this work as a foundational proposal, explicitly inviting the scientific community to join an open science process of consensus building. Through this collaborative refinement, we aim to evolve PRISMA-trAIce into a formally endorsed guideline, thereby ensuring the collective validation and scientific rigor of future AI-driven research.

Schlagwörter

Stichwörter der Autor:innen

AIPRISMAPreferred Reporting Items for Systematic Reviews and Meta-Analysesartificial intelligenceevidence synthesislarge language modelsreporting guidelinesystematic literature reviewtransparency

Autor:innen und Institutionen

  • Institute of Aircraft Production Technology, Hamburg University of Technology, Am Schwarzenberg-Campus 1, Hamburg, 21073, Germany, 49 17689103318, 49 40427314551.

Zitieren

APA

Holst, D., Moenck, K., Koch, J., Schmedemann, O., & Schüppstuhl, T. (2025). Transparent Reporting of AI in Systematic Literature Reviews: Development of the PRISMA-trAIce Checklist. JMIR AI, 4, e80247-e80247. https://doi.org/10.2196/80247

Vancouver

Holst D, Moenck K, Koch J, Schmedemann O, Schüppstuhl T. Transparent Reporting of AI in Systematic Literature Reviews: Development of the PRISMA-trAIce Checklist. JMIR AI. 2025;4:e80247-e80247. doi:10.2196/80247

BibTeX
@article{Holst2025,
  author = {Holst, Dirk and Moenck, Keno and Koch, Julian and Schmedemann, Ole and Schüppstuhl, Thorsten},
  title = {Transparent Reporting of AI in Systematic Literature Reviews: Development of the PRISMA-trAIce Checklist},
  journal = {JMIR AI},
  year = {2025},
  volume = {4},
  pages = {e80247--e80247},
  doi = {10.2196/80247}
}
Kostenlos starten →