EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multi-modal neural network for ECG signal classification in coronary artery disease using gramian angular field

Yong Jiang, Xiang Pan, Ying Zhao, Xin-hua Zou, Han-qi Yang, Kai-qi Li, Yan-ting Zhu, Jian-zhe Huang, Shi-yun Nie, Jia-yin Wang, Ting-miao Tang

Frontiers in Cardiovascular Medicine · 16.11.2026 · 13

DOI: 10.3389/fcvm.2026.1844501 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Cardiovascular Medicine, online erschienen am 16.11.2026. Verfasst von Yong Jiang und 10 weiteren Autor:innen. Die Arbeit nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Cardiovascular diseases (CVDs) remain a major global health burden, and electrocardiogram (ECG) classification is an important component of automated cardiac screening. However, conventional deep learning approaches may lose complementary information when operating on a single representation of the signal. This study aims to develop a multimodal method for normal-versus-abnormal ECG heartbeat classification under patient-independent evaluation.

Methods

We propose a multi-modal neural network that integrates raw ECG signals and their Gramian Angular Field (GAF) image representations. This dual-modal strategy enables the model to capture complementary time-series and two-dimensional structural features. The classifier combines lightweight multi-head attention with a residual feed-forward network, and the ECG, GASF, and fused representations provide coordinated prediction pathways followed by majority voting. To address generalization and patient-level leakage concerns, all formal experiments used strict patient-level five-fold cross-validation with patient-disjoint training, validation, and test partitions. Checkpoints were selected using validation ROC AUC, and the same fixed patient partitions were used for the ablation study and the BiLSTM/CNN + Transformer comparisons.

Results

Under the strict patient-level five-fold protocol, the Full Multimodal model achieved a ROC AUC of 0.996 and an accuracy (ACC) of 0.983. In the protocol-matched comparison, ECG-only achieved 0.815/0.846, BiLSTM 0.758/0.842, and CNN + Transformer 0.854/0.884 for ROC AUC/ACC, respectively. The ablation variants all showed lower ROC AUC and ACC than the complete model, supporting the contribution of the coordinated multimodal framework.

Conclusion

The proposed framework provides a patient-independent approach to normal-versus-abnormal ECG heartbeat classification by coordinating raw ECG and GASF representations. The revised patient-level cross-validation, component-level ablation, protocol-matched comparison, and updated literature context provide a more rigorous evaluation of the framework while supporting further validation in broader and external ECG cohorts.

Zitieren

APA

Jiang, Y., Pan, X., Zhao, Y., Zou, X., Yang, H., Li, K., Zhu, Y., Huang, J., Nie, S., Wang, J., & Tang, T. (2026). Multi-modal neural network for ECG signal classification in coronary artery disease using gramian angular field. Frontiers in Cardiovascular Medicine, 13. https://doi.org/10.3389/fcvm.2026.1844501

Vancouver

Jiang Y, Pan X, Zhao Y, Zou X, Yang H, Li K, et al. Multi-modal neural network for ECG signal classification in coronary artery disease using gramian angular field. Frontiers in Cardiovascular Medicine. 2026;13. doi:10.3389/fcvm.2026.1844501

BibTeX
@article{Jiang2026,
  author = {Jiang, Yong and Pan, Xiang and Zhao, Ying and Zou, Xin-hua and Yang, Han-qi and Li, Kai-qi and Zhu, Yan-ting and Huang, Jian-zhe and Nie, Shi-yun and Wang, Jia-yin and Tang, Ting-miao},
  title = {Multi-modal neural network for ECG signal classification in coronary artery disease using gramian angular field},
  journal = {Frontiers in Cardiovascular Medicine},
  year = {2026},
  volume = {13},
  doi = {10.3389/fcvm.2026.1844501}
}
Kostenlos starten →