EUVIMEDSkopri EUVIMED
Open access

The Impact of Information Relevancy and Interactivity on Intensivists’ Trust in a Machine Learning–Based Bacteremia Prediction System: Simulation Study

Omer Katzburg iD, Michael Roimi iD, Amit Frenkel iD, Roy Ilan iD, Yuval Bitan iD

JMIR Human Factors · 2024-08-01 · 11 · e56924-e56924

DOI: 10.2196/56924 ↗

At a glance

Journal article in JMIR Human Factors, published online on 2024-08-01. Written by Omer Katzburg and 4 co-authors. Institution: Department of Health Policy and Management, Ben-Gurion University of the Negev, Be'er Sheva, Israel. Major MEDLINE topics: Machine Learning, Trust, Bacteremia, Decision Support Systems, Clinical. Cited 9 times so far (Crossref); 57 references. The full text is freely available in PubMed Central.

AstrattSubjectsDettalji biblijografiċiCiteRelated studies

Abstract (original language)

Background

The exponential growth in computing power and the increasing digitization of information have substantially advanced the machine learning (ML) research field. However, ML algorithms are often considered “black boxes,” and this fosters distrust. In medical domains, in which mistakes can result in fatal outcomes, practitioners may be especially reluctant to trust ML algorithms.

Objective

The aim of this study is to explore the effect of user-interface design features on intensivists’ trust in an ML-based clinical decision support system.

Methods

A total of 47 physicians from critical care specialties were presented with 3 patient cases of bacteremia in the setting of an ML-based simulation system. Three conditions of the simulation were tested according to combinations of information relevancy and interactivity. Participants’ trust in the system was assessed by their agreement with the system’s prediction and a postexperiment questionnaire. Linear regression models were applied to measure the effects.

Results

Participants’ agreement with the system’s prediction did not differ according to the experimental conditions. However, in the postexperiment questionnaire, higher information relevancy ratings and interactivity ratings were associated with higher perceived trust in the system ( P

Subjects

MeSH terms (MEDLINE)

Machine LearningTrustBacteremiaDecision Support Systems, ClinicalHumansMaleFemaleAdultMiddle AgedSurveys and QuestionnairesUser-Computer Interface

Author keywords

AIMLartificial intelligenceautomationclinical decision supportdecision makingdecision supportdecision support systemdecision support systemsdigitizationdigitization of informationhuman-MLhuman-ML interactionhuman-ML interactionshuman-automation interaction

Authors and institutions

  • Department of Health Policy and Management, Ben-Gurion University of the Negev, Be'er Sheva, Israel.
  • General Intensive Care Unit, Rambam Medical Center, Haifa, Israel.
  • General Intensive Care Unit, Soroka Medical Center, Be'er Sheva, Israel.

ORCID profiles: Omer Katzburg, Michael Roimi, Amit Frenkel, Roy Ilan, Yuval Bitan

Cite

APA

Katzburg, O., Roimi, M., Frenkel, A., Ilan, R., & Bitan, Y. (2024). The Impact of Information Relevancy and Interactivity on Intensivists’ Trust in a Machine Learning–Based Bacteremia Prediction System: Simulation Study. JMIR Human Factors, 11, e56924-e56924. https://doi.org/10.2196/56924

Vancouver

Katzburg O, Roimi M, Frenkel A, Ilan R, Bitan Y. The Impact of Information Relevancy and Interactivity on Intensivists’ Trust in a Machine Learning–Based Bacteremia Prediction System: Simulation Study. JMIR Human Factors. 2024;11:e56924-e56924. doi:10.2196/56924

BibTeX
@article{Katzburg2024,
  author = {Katzburg, Omer and Roimi, Michael and Frenkel, Amit and Ilan, Roy and Bitan, Yuval},
  title = {The Impact of Information Relevancy and Interactivity on Intensivists’ Trust in a Machine Learning–Based Bacteremia Prediction System: Simulation Study},
  journal = {JMIR Human Factors},
  year = {2024},
  volume = {11},
  pages = {e56924--e56924},
  doi = {10.2196/56924}
}
Start for free →