EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Co-design of Human-centered, Explainable AI for Clinical Decision Support

Cecilia Panigutti, Andrea Beretta, Daniele Fadda, Fosca Giannotti, Dino Pedreschi, Alan Perotti, Salvatore Rinzivillo

ACM Transactions on Interactive Intelligent Systems · 2023-12-31 · 13 (4) · 1-35

DOI: 10.1145/3587271 ↗

At a glance

Journal article in ACM Transactions on Interactive Intelligent Systems, published online on 2023-12-08. Written by Cecilia Panigutti and 6 co-authors. Cited 136 times so far (Crossref); 145 references. The full text is freely available (open access, CC BY 4.0). Funded by: European Union, HumanE AI Net, PNRR - M4C2 - Investimento 1.3, Partenariato Esteso.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

eXplainable AI (XAI) involves two intertwined but separate challenges: the development of techniques to extract explanations from black-box AI models and the way such explanations are presented to users, i.e., the explanation user interface. Despite its importance, the second aspect has received limited attention so far in the literature. Effective AI explanation interfaces are fundamental for allowing human decision-makers to take advantage and oversee high-risk AI systems effectively. Following an iterative design approach, we present the first cycle of prototyping-testing-redesigning of an explainable AI technique and its explanation user interface for clinical Decision Support Systems (DSS). We first present an XAI technique that meets the technical requirements of the healthcare domain: sequential, ontology-linked patient data, and multi-label classification tasks. We demonstrate its applicability to explain a clinical DSS, and we design a first prototype of an explanation user interface. Next, we test such a prototype with healthcare providers and collect their feedback with a two-fold outcome: First, we obtain evidence that explanations increase users’ trust in the XAI system, and second, we obtain useful insights on the perceived deficiencies of their interaction with the system, so we can re-design a better, more human-centered explanation interface.

Funding

  • European Union
  • HumanE AI Net
  • PNRR - M4C2 - Investimento 1.3, Partenariato Esteso
  • UK government

Cite

APA

Panigutti, C., Beretta, A., Fadda, D., Giannotti, F., Pedreschi, D., Perotti, A., & Rinzivillo, S. (2023). Co-design of Human-centered, Explainable AI for Clinical Decision Support. ACM Transactions on Interactive Intelligent Systems, 13(4), 1-35. https://doi.org/10.1145/3587271

Vancouver

Panigutti C, Beretta A, Fadda D, Giannotti F, Pedreschi D, Perotti A, et al. Co-design of Human-centered, Explainable AI for Clinical Decision Support. ACM Transactions on Interactive Intelligent Systems. 2023;13(4):1-35. doi:10.1145/3587271

BibTeX
@article{Panigutti2023,
  author = {Panigutti, Cecilia and Beretta, Andrea and Fadda, Daniele and Giannotti, Fosca and Pedreschi, Dino and Perotti, Alan and Rinzivillo, Salvatore},
  title = {Co-design of Human-centered, Explainable AI for Clinical Decision Support},
  journal = {ACM Transactions on Interactive Intelligent Systems},
  year = {2023},
  volume = {13},
  number = {4},
  pages = {1--35},
  doi = {10.1145/3587271}
}
Start for free →