Painting the Black Box White: Experimental Findings from Applying XAI to an ECG Reading Setting
Machine Learning and Knowledge Extraction · 2023-03-08 · 5 (1) · 269-286
DOI: 10.3390/make5010017 ↗At a glance
Journal article in Machine Learning and Knowledge Extraction, published online on 2023-03-08. Written by Federico Cabitza and 5 co-authors. Cited 31 times so far (Crossref); 80 references. The full text is freely available (open access, CC BY 4.0). Funded by: Italian Ministry of Health.
Abstract (original language)
The emergence of black-box, subsymbolic, and statistical AI systems has motivated a rapid increase in the interest regarding explainable AI (XAI), which encompasses both inherently explainable techniques, as well as approaches to make black-box AI systems explainable to human decision makers. Rather than always making black boxes transparent, these approaches are at risk of painting the black boxes white, thus failing to provide a level of transparency that would increase the system’s usability and comprehensibility, or even at risk of generating new errors (i.e., white-box paradox). To address these usability-related issues, in this work we focus on the cognitive dimension of users’ perception of explanations and XAI systems. We investigated these perceptions in light of their relationship with users’ characteristics (e.g., expertise) through a questionnaire-based user study involved 44 cardiology residents and specialists in an AI-supported ECG reading task. Our results point to the relevance and correlation of the dimensions of trust, perceived quality of explanations, and tendency to defer the decision process to automation (i.e., technology dominance). This contribution calls for the evaluation of AI-based support systems from a human–AI interaction-oriented perspective, laying the ground for further investigation of XAI and its effects on decision making and user experience.
Funding
- Italian Ministry of Health
Cite
APA
Cabitza, F., Campagner, A., Natali, C., Parimbelli, E., Ronzio, L., & Cameli, M. (2023). Painting the Black Box White: Experimental Findings from Applying XAI to an ECG Reading Setting. Machine Learning and Knowledge Extraction, 5(1), 269-286. https://doi.org/10.3390/make5010017
Vancouver
Cabitza F, Campagner A, Natali C, Parimbelli E, Ronzio L, Cameli M. Painting the Black Box White: Experimental Findings from Applying XAI to an ECG Reading Setting. Machine Learning and Knowledge Extraction. 2023;5(1):269-286. doi:10.3390/make5010017
BibTeX
@article{Cabitza2023,
author = {Cabitza, Federico and Campagner, Andrea and Natali, Chiara and Parimbelli, Enea and Ronzio, Luca and Cameli, Matteo},
title = {Painting the Black Box White: Experimental Findings from Applying XAI to an ECG Reading Setting},
journal = {Machine Learning and Knowledge Extraction},
year = {2023},
volume = {5},
number = {1},
pages = {269--286},
doi = {10.3390/make5010017}
}
EUVIMED