EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Attention-Fusion-Based Two-Stream Vision Transformer for Heart Sound Classification

Kalpeshkumar Ranipa iD, Wei-Ping Zhu, M N S Swamy

Bioengineering · 26.09.2025 · 12 (10) · 1033

DOI: 10.3390/bioengineering12101033 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Bioengineering, online erschienen am 26.09.2025. Verfasst von Kalpeshkumar Ranipa und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Computer Engineering, Concordia University, Montreal, QC H3G 1M8, Canada. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Sciences and Engineering Research Council of Canada, Regroupement Stratégique en Microsystèmes du Québec (ReSMiQ).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Vision Transformers (ViTs), inspired by their success in natural language processing, have recently gained attention for heart sound classification (HSC). However, most of the existing studies on HSC rely on single-stream architectures, overlooking the advantages of multi-resolution features. While multi-stream architectures employing early or late fusion strategies have been proposed, they often fall short of effectively capturing cross-modal feature interactions. Additionally, conventional fusion methods, such as concatenation, averaging, or max pooling, frequently result in information loss. To address these limitations, this paper presents a novel attention fusion-based two-stream Vision Transformer (AFTViT) architecture for HSC that leverages two-dimensional mel-cepstral domain features. The proposed method employs a ViT-based encoder to capture long-range dependencies and diverse contextual information at multiple scales. A novel attention block is then used to integrate cross-context features at the feature level, enhancing the overall feature representation. Experiments conducted on the PhysioNet2016 and PhysioNet2022 datasets demonstrate that the AFTViT outperforms state-of-the-art CNN-based methods in terms of accuracy. These results highlight the potential of the AFTViT framework for early diagnosis of cardiovascular diseases, offering a valuable tool for cardiologists and researchers in developing advanced HSC techniques.

Schlagwörter

Stichwörter der Autor:innen

attention fusiondeep learningheart sound classificationvision transformer

Autor:innen und Institutionen

  • Department of Electrical and Computer Engineering, Concordia University, Montreal, QC H3G 1M8, Canada.

ORCID-Profile: Kalpeshkumar Ranipa

Förderung

  • Natural Sciences and Engineering Research Council of Canada
  • Regroupement Stratégique en Microsystèmes du Québec (ReSMiQ)

Zitieren

APA

Ranipa, K., Zhu, W. P., & Swamy, M. N. S. (2025). Attention-Fusion-Based Two-Stream Vision Transformer for Heart Sound Classification. Bioengineering, 12(10), 1033. https://doi.org/10.3390/bioengineering12101033

Vancouver

Ranipa K, Zhu WP, Swamy MNS. Attention-Fusion-Based Two-Stream Vision Transformer for Heart Sound Classification. Bioengineering. 2025;12(10):1033. doi:10.3390/bioengineering12101033

BibTeX
@article{Ranipa2025,
  author = {Ranipa, Kalpeshkumar and Zhu, Wei-Ping and Swamy, M N S},
  title = {Attention-Fusion-Based Two-Stream Vision Transformer for Heart Sound Classification},
  journal = {Bioengineering},
  year = {2025},
  volume = {12},
  number = {10},
  pages = {1033},
  doi = {10.3390/bioengineering12101033}
}
Kostenlos starten →