Deep Multimodal Learning for Heart Sound Classification Using CNN, Transformer, and BiLSTM with Attention
Symmetry · 25.03.2026 · 18 (4) · 556
DOI: 10.3390/sym18040556 ↗Kurz gefasst
Fachartikel in der Zeitschrift Symmetry, online erschienen am 25.03.2026. Verfasst von Ilyas Ait Ichou und 3 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Phonocardiogram (PCG) signals offer a non-invasive, low-cost screening tool for cardiovascular diseases. However, their noisy and non-stationary nature makes automated classification challenging, and traditional methods often fail to capture complex spectral-temporal patterns. This study proposes a multimodal deep learning architecture for the binary classification of heart sounds (Healthy vs. Unhealthy). The hybrid model integrates Convolutional Neural Networks (CNNs), Transformer encoders, and Bidirectional Long Short-Term Memory (BiLSTM) networks with an attention mechanism. It utilizes an early-fusion feature extraction pipeline combining MFCCs, Mel-spectrograms, and Chroma descriptors. To ensure robust evaluation and prevent data leakage, SMOTE is applied exclusively to the training folds within a strict zero-leakage, patient-wise 5-fold cross-validation protocol. The proposed framework demonstrates exceptional performance, achieving an average accuracy of 91.67%, a sensitivity of 80.95%, a specificity of 94.46%, and an AUC-ROC of 96.50%. An ablation study confirms that integrating Transformer and BiLSTM modules significantly enhances diagnostic stability over baseline CNNs. Furthermore, with exactly 858,434 parameters (3.27 MB) and interpretable attention maps, this highly optimized model provides a robust assistive solution suitable for deployment in digital stethoscopes and mobile telemedicine systems.
Zitieren
APA
Ichou, I. A., Elouaham, S., Nassiri, B., & Isknan, J. (2026). Deep Multimodal Learning for Heart Sound Classification Using CNN, Transformer, and BiLSTM with Attention. Symmetry, 18(4), 556. https://doi.org/10.3390/sym18040556
Vancouver
Ichou IA, Elouaham S, Nassiri B, Isknan J. Deep Multimodal Learning for Heart Sound Classification Using CNN, Transformer, and BiLSTM with Attention. Symmetry. 2026;18(4):556. doi:10.3390/sym18040556
BibTeX
@article{Ichou2026,
author = {Ichou, Ilyas Ait and Elouaham, Samir and Nassiri, Boujemaa and Isknan, Jamal},
title = {Deep Multimodal Learning for Heart Sound Classification Using CNN, Transformer, and BiLSTM with Attention},
journal = {Symmetry},
year = {2026},
volume = {18},
number = {4},
pages = {556},
doi = {10.3390/sym18040556}
}
EUVIMED