Trust in Machine Learning Driven Clinical Decision Support Tools Among Otolaryngologists
The Laryngoscope · 2024
DOI: 10.1002/lary.31260 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Laryngoscope, 2024. Verfasst von Hannah Chen und 5 weiteren Autor:innen. Beteiligte Einrichtung: Sean Parker Institute for the Voice, Department of Otolaryngology-Head and Neck Surgery, Weill Cornell Medicine, New York, New York, USA. Hauptthemen laut MEDLINE: Machine Learning, Otolaryngologists, Decision Support Systems, Clinical, Trust. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 28 Literaturangaben. Gefördert von: NIA NIH HHS, ODCDC CDC HHS.
Abstract (Originalsprache)
Background
Machine learning driven clinical decision support tools (ML‐CDST) are on the verge of being integrated into clinical settings, including in Otolaryngology‐Head & Neck Surgery. In this study, we investigated whether such CDST may influence otolaryngologists' diagnostic judgement.
Methods
Otolaryngologists were recruited virtually across the United States for this experiment on human–AI interaction. Participants were shown 12 different video‐stroboscopic exams from patients with previously diagnosed laryngopharyngeal reflux or vocal fold paresis and asked to determine the presence of disease. They were then exposed to a random diagnosis purportedly resulting from an ML‐CDST and given the opportunity to revise their diagnosis. The ML‐CDST output was presented with no explanation, a general explanation, or a specific explanation of its logic. The ML‐CDST impact on diagnostic judgement was assessed with McNemar's test.
Results
Forty‐five participants were recruited. When participants reported less confidence (268 observations), they were significantly ( p = 0.001) more likely to change their diagnostic judgement after exposure to ML‐CDST output compared to when they reported more confidence (238 observations). Participants were more likely to change their diagnostic judgement when presented with a specific explanation of the CDST logic ( p = 0.048).
Conclusions
Our study suggests that otolaryngologists are susceptible to accepting ML‐CDST diagnostic recommendations, especially when less confident. Otolaryngologists' trust in ML‐CDST output is increased when accompanied with a specific explanation of its logic. Level of Evidence 2 Laryngoscope , 134:2799–2804, 2024
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Sean Parker Institute for the Voice, Department of Otolaryngology-Head and Neck Surgery, Weill Cornell Medicine, New York, New York, USA.
- Division of Biostatistics, Department of Population Health Sciences, Weill Cornell Medical College, New York, New York, USA.
ORCID-Profile: Hannah Chen, Anaïs Rameau
Förderung
- NIA NIH HHS
- ODCDC CDC HHS
Zitieren
APA
Chen, H., Ma, X., Rives, H., Serpedin, A., Yao, P., & Rameau, A. (2024). Trust in Machine Learning Driven Clinical Decision Support Tools Among Otolaryngologists. The Laryngoscope. https://doi.org/10.1002/lary.31260
Vancouver
Chen H, Ma X, Rives H, Serpedin A, Yao P, Rameau A. Trust in Machine Learning Driven Clinical Decision Support Tools Among Otolaryngologists. The Laryngoscope. 2024. doi:10.1002/lary.31260
BibTeX
@article{Chen2024,
author = {Chen, Hannah and Ma, Xiaoyue and Rives, Hal and Serpedin, Aisha and Yao, Peter and Rameau, Anaïs},
title = {Trust in Machine Learning Driven Clinical Decision Support Tools Among Otolaryngologists},
journal = {The Laryngoscope},
year = {2024},
doi = {10.1002/lary.31260}
}
EUVIMED