The Impact of Information Relevancy and Interactivity on Intensivists’ Trust in a Machine Learning–Based Bacteremia Prediction System: Simulation Study
JMIR Human Factors · 2024-08-01 · 11 · e56924-e56924
DOI: 10.2196/56924 ↗At a glance
Journal article in JMIR Human Factors, published online on 2024-08-01. Written by Omer Katzburg and 4 co-authors. Institution: Department of Health Policy and Management, Ben-Gurion University of the Negev, Be'er Sheva, Israel. Major MEDLINE topics: Machine Learning, Trust, Bacteremia, Decision Support Systems, Clinical. Cited 9 times so far (Crossref); 57 references. The full text is freely available in PubMed Central.
Topics: Künstliche Intelligenz in der Pflege, Simulation in der Pflegeausbildung
Abstract (original language)
Background
The exponential growth in computing power and the increasing digitization of information have substantially advanced the machine learning (ML) research field. However, ML algorithms are often considered “black boxes,” and this fosters distrust. In medical domains, in which mistakes can result in fatal outcomes, practitioners may be especially reluctant to trust ML algorithms.
Objective
The aim of this study is to explore the effect of user-interface design features on intensivists’ trust in an ML-based clinical decision support system.
Methods
A total of 47 physicians from critical care specialties were presented with 3 patient cases of bacteremia in the setting of an ML-based simulation system. Three conditions of the simulation were tested according to combinations of information relevancy and interactivity. Participants’ trust in the system was assessed by their agreement with the system’s prediction and a postexperiment questionnaire. Linear regression models were applied to measure the effects.
Results
Participants’ agreement with the system’s prediction did not differ according to the experimental conditions. However, in the postexperiment questionnaire, higher information relevancy ratings and interactivity ratings were associated with higher perceived trust in the system ( P
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Department of Health Policy and Management, Ben-Gurion University of the Negev, Be'er Sheva, Israel.
- General Intensive Care Unit, Rambam Medical Center, Haifa, Israel.
- General Intensive Care Unit, Soroka Medical Center, Be'er Sheva, Israel.
ORCID profiles: Omer Katzburg, Michael Roimi, Amit Frenkel, Roy Ilan, Yuval Bitan
Cite
APA
Katzburg, O., Roimi, M., Frenkel, A., Ilan, R., & Bitan, Y. (2024). The Impact of Information Relevancy and Interactivity on Intensivists’ Trust in a Machine Learning–Based Bacteremia Prediction System: Simulation Study. JMIR Human Factors, 11, e56924-e56924. https://doi.org/10.2196/56924
Vancouver
Katzburg O, Roimi M, Frenkel A, Ilan R, Bitan Y. The Impact of Information Relevancy and Interactivity on Intensivists’ Trust in a Machine Learning–Based Bacteremia Prediction System: Simulation Study. JMIR Human Factors. 2024;11:e56924-e56924. doi:10.2196/56924
BibTeX
@article{Katzburg2024,
author = {Katzburg, Omer and Roimi, Michael and Frenkel, Amit and Ilan, Roy and Bitan, Yuval},
title = {The Impact of Information Relevancy and Interactivity on Intensivists’ Trust in a Machine Learning–Based Bacteremia Prediction System: Simulation Study},
journal = {JMIR Human Factors},
year = {2024},
volume = {11},
pages = {e56924--e56924},
doi = {10.2196/56924}
}
EUVIMED