EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multimodal Explainability Using Class Activation Maps and Canonical Correlation for MI-EEG Deep Learning Classification

Marcos Loaiza-Arias, Andrés Marino Álvarez-Meza, David Cárdenas-Peña, Álvaro Ángel Orozco-Gutierrez, German Castellanos-Dominguez

Applied Sciences · 01.12.2024 · 14 (23) · 11208

DOI: 10.3390/app142311208 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 01.12.2024. Verfasst von Marcos Loaiza-Arias und 4 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 73 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Sistema de monitoreo automático para la evaluación clínica de infantes con alteraciones neurológicas motoras mediante el análisis de volumetría cerebral y patr…, MINCIENCIAS, Sistema de integración de EEG, ECG y SpO2 para seguimiento de neonatos en unidad de cuidados intensivos del Hospital Universitario de Caldas - SES HUC.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Brain–computer interfaces (BCIs) are essential in advancing medical diagnosis and treatment by providing non-invasive tools to assess neurological states. Among these, motor imagery (MI), in which patients mentally simulate motor tasks without physical movement, has proven to be an effective paradigm for diagnosing and monitoring neurological conditions. Electroencephalography (EEG) is widely used for MI data collection due to its high temporal resolution, cost-effectiveness, and portability. However, EEG signals can be noisy from a number of sources, including physiological artifacts and electromagnetic interference. They can also vary from person to person, which makes it harder to extract features and understand the signals. Additionally, this variability, influenced by genetic and cognitive factors, presents challenges for developing subject-independent solutions. To address these limitations, this paper presents a Multimodal and Explainable Deep Learning (MEDL) approach for MI-EEG classification and physiological interpretability. Our approach involves the following: (i) evaluating different deep learning (DL) models for subject-dependent MI-EEG discrimination; (ii) employing class activation mapping (CAM) to visualize relevant MI-EEG features; and (iii) utilizing a questionnaire–MI performance canonical correlation analysis (QMIP-CCA) to provide multidomain interpretability. On the GIGAScience MI dataset, experiments show that shallow neural networks are good at classifying MI-EEG data, while the CAM-based method finds spatio-frequency patterns. Moreover, the QMIP-CCA framework successfully correlates physiological data with MI-EEG performance, offering an enhanced, interpretable solution for BCIs.

Förderung

  • Sistema de monitoreo automático para la evaluación clínica de infantes con alteraciones neurológicas motoras mediante el análisis de volumetría cerebral y patr…
  • MINCIENCIAS
  • Sistema de integración de EEG, ECG y SpO2 para seguimiento de neonatos en unidad de cuidados intensivos del Hospital Universitario de Caldas - SES HUC

Zitieren

APA

Loaiza-Arias, M., Álvarez-Meza, A. M., Cárdenas-Peña, D., Orozco-Gutierrez, Á. Á., & Castellanos-Dominguez, G. (2024). Multimodal Explainability Using Class Activation Maps and Canonical Correlation for MI-EEG Deep Learning Classification. Applied Sciences, 14(23), 11208. https://doi.org/10.3390/app142311208

Vancouver

Loaiza-Arias M, Álvarez-Meza AM, Cárdenas-Peña D, Orozco-Gutierrez ÁÁ, Castellanos-Dominguez G. Multimodal Explainability Using Class Activation Maps and Canonical Correlation for MI-EEG Deep Learning Classification. Applied Sciences. 2024;14(23):11208. doi:10.3390/app142311208

BibTeX
@article{LoaizaArias2024,
  author = {Loaiza-Arias, Marcos and Álvarez-Meza, Andrés Marino and Cárdenas-Peña, David and Orozco-Gutierrez, Álvaro Ángel and Castellanos-Dominguez, German},
  title = {Multimodal Explainability Using Class Activation Maps and Canonical Correlation for MI-EEG Deep Learning Classification},
  journal = {Applied Sciences},
  year = {2024},
  volume = {14},
  number = {23},
  pages = {11208},
  doi = {10.3390/app142311208}
}
Kostenlos starten →