EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access

Human-centered explainability evaluation in clinical decision-making: a critical review of the literature

Jenny M Bauer, Martin Michalowski iD

Journal of the American Medical Informatics Association · 01.09.2025 · 32 (9) · 1477-1484

DOI: 10.1093/jamia/ocaf110 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Journal of the American Medical Informatics Association, online erschienen am 14.07.2025. Verfasst von Jenny M Bauer und 1 weiteren Autor:innen. Beteiligte Einrichtung: School of Nursing, University of Minnesota, Minneapolis, MN 55455, United States. Hauptthemen laut MEDLINE: Artificial Intelligence, Clinical Decision-Making, Decision Support Systems, Clinical. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 57 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objectives

This review paper comprehensively summarizes healthcare provider (HCP) evaluation of explanations produced by explainable artificial intelligence methods to support point-of-care, patient-specific, clinical decision-making (CDM) within medical settings. It highlights the critical need to incorporate human-centered (HCP) evaluation approaches based on their CDM needs, processes, and goals. Materials and Methods The review was conducted in Ovid Medline and Scopus databases, following the Institute of Medicine’s methodological standards and PRISMA guidelines. An individual study appraisal was conducted using design-specific appraisal tools. MaxQDA software was used for data extraction and evidence table procedures.

Results

Of the 2673 unique records retrieved, 25 records were included in the final sample. Studies were excluded if they did not meet this review’s definitions of HCP evaluation (1156), healthcare use (995), explainable AI (211), and primary research (285), and if they were not available in English (1). The sample focused primarily on physicians and diagnostic imaging use cases and revealed wide-ranging evaluation measures.

Discussion

The synthesis of sampled studies suggests a potential common measure of clinical explainability with 3 indicators of interpretability, fidelity, and clinical value. There is an opportunity to extend the current model-centered evaluation approaches to incorporate human-centered metrics, supporting the transition into practice.

Conclusion

Future research should aim to clarify and expand key concepts in HCP evaluation, propose a comprehensive evaluation model positioned in current theoretical knowledge, and develop a valid instrument to support comparisons.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceClinical Decision-MakingDecision Support Systems, ClinicalHumans

Stichwörter der Autor:innen

XAIdecision-makingexplainable artificial intelligencehealthcarehuman-centered evaluation

Autor:innen und Institutionen

  • School of Nursing, University of Minnesota, Minneapolis, MN 55455, United States.

ORCID-Profile: Martin Michalowski

Zitieren

APA

Bauer, J. M., & Michalowski, M. (2025). Human-centered explainability evaluation in clinical decision-making: a critical review of the literature. Journal of the American Medical Informatics Association, 32(9), 1477-1484. https://doi.org/10.1093/jamia/ocaf110

Vancouver

Bauer JM, Michalowski M. Human-centered explainability evaluation in clinical decision-making: a critical review of the literature. Journal of the American Medical Informatics Association. 2025;32(9):1477-1484. doi:10.1093/jamia/ocaf110

BibTeX
@article{Bauer2025,
  author = {Bauer, Jenny M and Michalowski, Martin},
  title = {Human-centered explainability evaluation in clinical decision-making: a critical review of the literature},
  journal = {Journal of the American Medical Informatics Association},
  year = {2025},
  volume = {32},
  number = {9},
  pages = {1477--1484},
  doi = {10.1093/jamia/ocaf110}
}
Kostenlos starten →