EUVIMEDAtrasti EUVIMED
Open access

Clinicians’ Trust in AI-Based Clinical Recommendations Across Controlled Primary Care–Style Clinical Vignettes: Nurse-Dominant Experimental Pilot Study

Avishek Choudhury iD, Yeganeh Shahsavar iD, Ayse P Gurses iD

JMIR Human Factors · 2026

DOI: 10.2196/97649 ↗

At a glance

Journal article in JMIR Human Factors, 2026. Written by Avishek Choudhury and 2 co-authors. Institution: Industrial and Management Systems Engineering, Benjamin M Statler College of Engineering and Mineral Resources, West Virginia University, Morgantown,…. Major MEDLINE topics: Trust, Primary Health Care, Artificial Intelligence, Decision Support Systems, Clinical. 35 references. The full text is freely available in PubMed Central.

SantraukaSubjectsBibliografiniai duomenysCiteRelated studies

Abstract (original language)

Background

Safe integration of AI-enabled clinical decision support requires understanding whether users’ trust and behavioral reliance are appropriately calibrated to recommendation quality.

Objective

This pilot study examined a 3-item vignette-level trust construct and accept or reject behavior across sequential primary care–style clinical vignettes.

Methods

A total of 68 health care professionals, including 59 (86.8%) registered nurses and 9 (13.2%) physicians, each evaluated 21 clinical vignettes from 1 of 2 series. Each series contained 10 correct and 11 intentionally incorrect AI recommendations. Participants accepted or rejected each recommendation and responded to 3 questionnaire items measuring trust, perceived transparency, and likelihood of acting on the recommendation before receiving correctness feedback and points. The unrounded item mean formed the trust composite. In the behavioral analysis, 50 unrecorded accept or reject responses were classified as rejections. A pooled cross-classified linear mixed-effects model was constructed to assess associations between the trust composite, recommendation correctness, vignette position, and participant and vignette characteristics. It included random intercepts for participant and vignette item, with case series included as a nuisance adjustment.

Results

Participants accepted 374 of 748 (50%) incorrect recommendations and rejected 112 of 680 (16.47%) correct recommendations. Incorrect recommendations received lower prefeedback trust than correct recommendations (β=−0.772, 95% CI −1.036 to −0.507; standardized effect=−0.419). Trust declined modestly across vignette positions (β=−0.027, 95% CI −0.048 to −0.005; standardized effect=−0.088), with a decline in case series A but not case series B. Baseline intention to use AI was positively associated with trust (β=0.391, 95% CI 0.110-0.672; standardized effect=0.243), whereas higher perceived diagnostic difficulty was negatively associated with trust (β=−0.474, 95% CI −0.648 to −0.301; standardized effect=−0.257). In the exploratory lagged model, trust in the preceding recommendation was associated with trust in the current recommendation (β=0.266, 95% CI 0.210-0.322; standardized effect=0.264).

Conclusions

Self-reported trust differentiated correct from incorrect recommendations in aggregate, while acceptance and rejection were not fully aligned with recommendation correctness. These preliminary findings identify a potential evaluation problem: lower trust in incorrect advice does not necessarily imply that users will reject it. The findings do not establish real-world clinical effects.

Subjects

MeSH terms (MEDLINE)

TrustPrimary Health CareArtificial IntelligenceDecision Support Systems, ClinicalNursesAttitude of Health PersonnelHumansPilot ProjectsFemaleMaleAdultMiddle AgedSurveys and Questionnaires

Author keywords

artificial intelligencebehavioral relianceclinical decision support systemsclinical vignetteshuman-AI interactionperceived difficultyregistered nursesrepeated interactiontrust calibrationtrust composite

Authors and institutions

  • Industrial and Management Systems Engineering, Benjamin M Statler College of Engineering and Mineral Resources, West Virginia University, Morgantown, WV, United States.
  • Armstrong Institute Center for Health Care Human Factors, Johns Hopkins Medicine, Johns Hopkins University, Baltimore, MD, United States.
  • Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Johns Hopkins University, Baltimore, MD, United States.

ORCID profiles: Avishek Choudhury, Yeganeh Shahsavar, Ayse P Gurses

Cite

APA

Choudhury, A., Shahsavar, Y., & Gurses, A. P. (2026). Clinicians’ Trust in AI-Based Clinical Recommendations Across Controlled Primary Care–Style Clinical Vignettes: Nurse-Dominant Experimental Pilot Study. JMIR Human Factors. https://doi.org/10.2196/97649

Vancouver

Choudhury A, Shahsavar Y, Gurses AP. Clinicians’ Trust in AI-Based Clinical Recommendations Across Controlled Primary Care–Style Clinical Vignettes: Nurse-Dominant Experimental Pilot Study. JMIR Human Factors. 2026. doi:10.2196/97649

BibTeX
@article{Choudhury2026,
  author = {Choudhury, Avishek and Shahsavar, Yeganeh and Gurses, Ayse P},
  title = {Clinicians’ Trust in AI-Based Clinical Recommendations Across Controlled Primary Care–Style Clinical Vignettes: Nurse-Dominant Experimental Pilot Study},
  journal = {JMIR Human Factors},
  year = {2026},
  doi = {10.2196/97649}
}
Start for free →