EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access · CC BY 4.0

Histopathology in focus: a review on explainable multi-modal approaches for breast cancer diagnosis

Faseela Abdullakutty, Younes Akbari, Somaya Al-Maadeed, Ahmed Bouridane, Iman M Talaat, Rifat Hamoudi

Frontiers in Medicine · 30.09.2024 · 11

DOI: 10.3389/fmed.2024.1450103 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Frontiers in Medicine, online erschienen am 30.09.2024. Verfasst von Faseela Abdullakutty und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science and Engineering, Qatar University, Doha, Qatar. Die Arbeit wurde bisher 69-mal zitiert (Crossref) und nennt 150 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Qatar National Library.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Precision and timeliness in breast cancer detection are paramount for improving patient outcomes. Traditional diagnostic methods have predominantly relied on unimodal approaches, but recent advancements in medical data analytics have enabled the integration of diverse data sources beyond conventional imaging techniques. This review critically examines the transformative potential of integrating histopathology images with genomic data, clinical records, and patient histories to enhance diagnostic accuracy and comprehensiveness in multi-modal diagnostic techniques. It explores early, intermediate, and late fusion methods, as well as advanced deep multimodal fusion techniques, including encoder-decoder architectures, attention-based mechanisms, and graph neural networks. An overview of recent advancements in multimodal tasks such as Visual Question Answering (VQA), report generation, semantic segmentation, and cross-modal retrieval is provided, highlighting the utilization of generative AI and visual language models. Additionally, the review delves into the role of Explainable Artificial Intelligence (XAI) in elucidating the decision-making processes of sophisticated diagnostic algorithms, emphasizing the critical need for transparency and interpretability. By showcasing the importance of explainability, we demonstrate how XAI methods, including Grad-CAM, SHAP, LIME, trainable attention, and image captioning, enhance diagnostic precision, strengthen clinician confidence, and foster patient engagement. The review also discusses the latest XAI developments, such as X-VARs, LeGrad, LangXAI, LVLM-Interpret, and ex-ILP, to demonstrate their potential utility in multimodal breast cancer detection, while identifying key research gaps and proposing future directions for advancing the field.

Schlagwörter

Stichwörter der Autor:innen

XAIbreast cancer detectionhistopathologymachine learning and AImulti-modality

Autor:innen und Institutionen

  • Department of Computer Science and Engineering, Qatar University, Doha, Qatar.
  • Computer Engineering Department, College of Computing and Informatics, University of Sharjah, Sharjah, United Arab Emirates.
  • Clinical Sciences Department, College of Medicine, University of Sharjah, Sharjah, United Arab Emirates.
  • Research Institute for Medical and Health Sciences, University of Sharjah, Sharjah, United Arab Emirates.

Förderung

  • Qatar National Library

Zitieren

APA

Abdullakutty, F., Akbari, Y., Al-Maadeed, S., Bouridane, A., Talaat, I. M., & Hamoudi, R. (2024). Histopathology in focus: a review on explainable multi-modal approaches for breast cancer diagnosis. Frontiers in Medicine, 11. https://doi.org/10.3389/fmed.2024.1450103

Vancouver

Abdullakutty F, Akbari Y, Al-Maadeed S, Bouridane A, Talaat IM, Hamoudi R. Histopathology in focus: a review on explainable multi-modal approaches for breast cancer diagnosis. Frontiers in Medicine. 2024;11. doi:10.3389/fmed.2024.1450103

BibTeX
@article{Abdullakutty2024,
  author = {Abdullakutty, Faseela and Akbari, Younes and Al-Maadeed, Somaya and Bouridane, Ahmed and Talaat, Iman M and Hamoudi, Rifat},
  title = {Histopathology in focus: a review on explainable multi-modal approaches for breast cancer diagnosis},
  journal = {Frontiers in Medicine},
  year = {2024},
  volume = {11},
  doi = {10.3389/fmed.2024.1450103}
}
Kostenlos starten →