Explainability and causability in digital pathology
The Journal of Pathology: Clinical Research · 2023-07 · 9 (4) · 251-260
DOI: 10.1002/cjp2.322 ↗At a glance
Übersichtsarbeit in The Journal of Pathology: Clinical Research, published online on 2023-04-12. Written by Markus Plass and 9 co-authors. Institution: Diagnostic and Research Institute of Pathology, Medical University of Graz, Graz, Austria. Major MEDLINE topics: Artificial Intelligence, Pathologists. Cited 88 times so far (Crossref); 50 references. The full text is freely available (open access, CC BY 4.0). Funded by: Austrian Science Fund FWF, Austrian Science Fund, Horizon 2020 Framework Programme.
Abstract (original language)
The current move towards digital pathology enables pathologists to use artificial intelligence (AI)‐based computer programmes for the advanced analysis of whole slide images. However, currently, the best‐performing AI algorithms for image analysis are deemed black boxes since it remains – even to their developers – often unclear why the algorithm delivered a particular result. Especially in medicine, a better understanding of algorithmic decisions is essential to avoid mistakes and adverse effects on patients. This review article aims to provide medical experts with insights on the issue of explainability in digital pathology. A short introduction to the relevant underlying core concepts of machine learning shall nurture the reader's understanding of why explainability is a specific issue in this field. Addressing this issue of explainability, the rapidly evolving research field of explainable AI (XAI) has developed many techniques and methods to make black‐box machine‐learning systems more transparent. These XAI methods are a first step towards making black‐box AI systems understandable by humans. However, we argue that an explanation interface must complement these explainable models to make their results useful to human stakeholders and achieve a high level of causability, i.e. a high level of causal understanding by the user. This is especially relevant in the medical field since explainability and causability play a crucial role also for compliance with regulatory requirements. We conclude by promoting the need for novel user interfaces for AI applications in pathology, which enable contextual understanding and allow the medical expert to ask interactive ‘what‐if’‐questions. In pathology, such user interfaces will not only be important to achieve a high level of causability. They will also be crucial for keeping the human‐in‐the‐loop and bringing medical experts' experience and conceptual knowledge to AI processes.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Diagnostic and Research Institute of Pathology, Medical University of Graz, Graz, Austria.
- Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Pathology, Berlin, Germany.
- DAI-Labor, Agent Oriented Technologies (AOT), Technische Universität Berlin, Berlin, Germany.
- Human-Centered AI Lab, University of Natural Resources and Life Sciences Vienna, Vienna, Austria.
ORCID profiles: Markus Plass, Andreas Holzinger, Heimo Müller
Funding
- Austrian Science Fund FWF
- Austrian Science Fund
- Horizon 2020 Framework Programme
- Österreichische Forschungsförderungsgesellschaft
Cite
APA
Plass, M., Kargl, M., Kiehl, T. R., Regitnig, P., Geißler, C., Evans, T., Zerbe, N., Carvalho, R., Holzinger, A., & Müller, H. (2023). Explainability and causability in digital pathology. The Journal of Pathology: Clinical Research, 9(4), 251-260. https://doi.org/10.1002/cjp2.322
Vancouver
Plass M, Kargl M, Kiehl TR, Regitnig P, Geißler C, Evans T, et al. Explainability and causability in digital pathology. The Journal of Pathology: Clinical Research. 2023;9(4):251-260. doi:10.1002/cjp2.322
BibTeX
@article{Plass2023,
author = {Plass, Markus and Kargl, Michaela and Kiehl, Tim-Rasmus and Regitnig, Peter and Geißler, Christian and Evans, Theodore and Zerbe, Norman and Carvalho, Rita and Holzinger, Andreas and Müller, Heimo},
title = {Explainability and causability in digital pathology},
journal = {The Journal of Pathology: Clinical Research},
year = {2023},
volume = {9},
number = {4},
pages = {251--260},
doi = {10.1002/cjp2.322}
}
EUVIMED