EUVIMEDEUVIMED entdecken
Scoping ReviewStudienprotokollOpen Access

In Silico Evaluation of Algorithm-Based Clinical Decision Support Systems: Protocol for a Scoping Review

Michael Dorosan iD, Ya-Lin Chen iD, Qingyuan Zhuang iD, Shao Wei Sean Lam iD

JMIR Research Protocols · 2025

DOI: 10.2196/63875 ↗

Kurz gefasst

Scoping Review in der Zeitschrift JMIR Research Protocols, 2025. Verfasst von Michael Dorosan und 3 weiteren Autor:innen. Beteiligte Einrichtung: Health Services Research Centre, Singapore Health Services Pte Ltd, Singapore, Singapore. Hauptthemen laut MEDLINE: Decision Support Systems, Clinical, Algorithms, Computer Simulation. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 79 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Integrating algorithm-based clinical decision support (CDS) systems poses significant challenges in evaluating their actual clinical value. Such CDS systems are traditionally assessed via controlled but resource-intensive clinical trials.

Objective

This paper presents a review protocol for preimplementation in silico evaluation methods to enable broadened impact analysis under simulated environments before clinical trials.

Methods

We propose a scoping review protocol that follows an enhanced Arksey and O’Malley framework and PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines to investigate the scope and research gaps in the in silico evaluation of algorithm-based CDS models—specifically CDS decision-making end points and objectives, evaluation metrics used, and simulation paradigms used to assess potential impacts. The databases searched are PubMed, Embase, CINAHL, PsycINFO, Cochrane, IEEEXplore, Web of Science, and arXiv. A 2-stage screening process identified pertinent articles. The information extracted from articles was iteratively refined. The review will use thematic, trend, and descriptive analyses to meet scoping aims.

Results

We conducted an automated search of the databases above in May 2023, with most title and abstract screenings completed by November 2023 and full-text screening extended from December 2023 to May 2024. Concurrent charting and full-text analysis were carried out, with the final analysis and manuscript preparation set for completion in July 2024. Publication of the review results is targeted from July 2024 to February 2025. As of April 2024, a total of 21 articles have been selected following a 2-stage screening process; these will proceed to data extraction and analysis.

Conclusions

We refined our data extraction strategy through a collaborative, multidisciplinary approach, planning to analyze results using thematic analyses to identify approaches to in silico evaluation. Anticipated findings aim to contribute to developing a unified in silico evaluation framework adaptable to various clinical workflows, detailing clinical decision-making characteristics, impact measures, and reusability of methods. The study’s findings will be published and presented in forums combining artificial intelligence and machine learning, clinical decision-making, and health technology impact analysis. Ultimately, we aim to bridge the development-deployment gap through in silico evaluation-based potential impact assessments. International Registered Report Identifier (IRRID) DERR1-10.2196/63875

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Decision Support Systems, ClinicalAlgorithmsComputer SimulationScoping Reviews as TopicHumansResearch Design

Stichwörter der Autor:innen

algorithm-basedclinical decisionclinical decision support algorithmsclinical decision-makingclinical workflow simulationdecision supportdecision-makingdescriptive analysisdigital twinhealth care modelingin silico evaluationprotocolquadruple aimsscoping reviewscreening

Autor:innen und Institutionen

  • Health Services Research Centre, Singapore Health Services Pte Ltd, Singapore, Singapore.
  • Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, WA, United States.
  • Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore, Singapore.
  • Data and Computational Science Core, National Cancer Centre Singapore, Singapore, Singapore.
  • Duke-NUS Medical School, National University of Singapore, Singapore, Singapore.
  • Health Services Research Institute, SingHealth Duke-NUS Academic Medical Centre, Singapore, Singapore.

ORCID-Profile: Michael Dorosan, Ya-Lin Chen, Qingyuan Zhuang, Shao Wei Sean Lam

Zitieren

APA

Dorosan, M., Chen, Y. L., Zhuang, Q., & Lam, S. W. S. (2025). In Silico Evaluation of Algorithm-Based Clinical Decision Support Systems: Protocol for a Scoping Review. JMIR Research Protocols. https://doi.org/10.2196/63875

Vancouver

Dorosan M, Chen YL, Zhuang Q, Lam SWS. In Silico Evaluation of Algorithm-Based Clinical Decision Support Systems: Protocol for a Scoping Review. JMIR Research Protocols. 2025. doi:10.2196/63875

BibTeX
@article{Dorosan2025,
  author = {Dorosan, Michael and Chen, Ya-Lin and Zhuang, Qingyuan and Lam, Shao Wei Sean},
  title = {In Silico Evaluation of Algorithm-Based Clinical Decision Support Systems: Protocol for a Scoping Review},
  journal = {JMIR Research Protocols},
  year = {2025},
  doi = {10.2196/63875}
}
Kostenlos starten →