Multi-modal neural network for ECG signal classification in coronary artery disease using gramian angular field
Frontiers in Cardiovascular Medicine · 16.11.2026 · 13
DOI: 10.3389/fcvm.2026.1844501 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Cardiovascular Medicine, online erschienen am 16.11.2026. Verfasst von Yong Jiang und 10 weiteren Autor:innen. Die Arbeit nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Cardiovascular diseases (CVDs) remain a major global health burden, and electrocardiogram (ECG) classification is an important component of automated cardiac screening. However, conventional deep learning approaches may lose complementary information when operating on a single representation of the signal. This study aims to develop a multimodal method for normal-versus-abnormal ECG heartbeat classification under patient-independent evaluation.
Methods
We propose a multi-modal neural network that integrates raw ECG signals and their Gramian Angular Field (GAF) image representations. This dual-modal strategy enables the model to capture complementary time-series and two-dimensional structural features. The classifier combines lightweight multi-head attention with a residual feed-forward network, and the ECG, GASF, and fused representations provide coordinated prediction pathways followed by majority voting. To address generalization and patient-level leakage concerns, all formal experiments used strict patient-level five-fold cross-validation with patient-disjoint training, validation, and test partitions. Checkpoints were selected using validation ROC AUC, and the same fixed patient partitions were used for the ablation study and the BiLSTM/CNN + Transformer comparisons.
Results
Under the strict patient-level five-fold protocol, the Full Multimodal model achieved a ROC AUC of 0.996 and an accuracy (ACC) of 0.983. In the protocol-matched comparison, ECG-only achieved 0.815/0.846, BiLSTM 0.758/0.842, and CNN + Transformer 0.854/0.884 for ROC AUC/ACC, respectively. The ablation variants all showed lower ROC AUC and ACC than the complete model, supporting the contribution of the coordinated multimodal framework.
Conclusion
The proposed framework provides a patient-independent approach to normal-versus-abnormal ECG heartbeat classification by coordinating raw ECG and GASF representations. The revised patient-level cross-validation, component-level ablation, protocol-matched comparison, and updated literature context provide a more rigorous evaluation of the framework while supporting further validation in broader and external ECG cohorts.
Zitieren
APA
Jiang, Y., Pan, X., Zhao, Y., Zou, X., Yang, H., Li, K., Zhu, Y., Huang, J., Nie, S., Wang, J., & Tang, T. (2026). Multi-modal neural network for ECG signal classification in coronary artery disease using gramian angular field. Frontiers in Cardiovascular Medicine, 13. https://doi.org/10.3389/fcvm.2026.1844501
Vancouver
Jiang Y, Pan X, Zhao Y, Zou X, Yang H, Li K, et al. Multi-modal neural network for ECG signal classification in coronary artery disease using gramian angular field. Frontiers in Cardiovascular Medicine. 2026;13. doi:10.3389/fcvm.2026.1844501
BibTeX
@article{Jiang2026,
author = {Jiang, Yong and Pan, Xiang and Zhao, Ying and Zou, Xin-hua and Yang, Han-qi and Li, Kai-qi and Zhu, Yan-ting and Huang, Jian-zhe and Nie, Shi-yun and Wang, Jia-yin and Tang, Ting-miao},
title = {Multi-modal neural network for ECG signal classification in coronary artery disease using gramian angular field},
journal = {Frontiers in Cardiovascular Medicine},
year = {2026},
volume = {13},
doi = {10.3389/fcvm.2026.1844501}
}
EUVIMED