EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MFSleepNet: An Interactive Multimodal Fusion Framework for Automatic Sleep Staging

Ranran Gui, Chen Wang, Qunfeng Niu iD, Li Wang

Sensors · 2026

DOI: 10.3390/s26103085 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2026. Verfasst von Ranran Gui und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Electronic and Electrical Engineering, Zhengzhou University of Science and Technology, Zhengzhou 450064, China. Hauptthemen laut MEDLINE: Sleep Stages. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: the Key Research and Development Special Fund of Henan Province, Open Project of Henan University of Technology Institute for Complexity Science.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurate automatic sleep staging remains challenging due to complex temporal dynamics, inter-subject variability, and the difficulty of effectively integrating heterogeneous physiological signals. Electroencephalogram (EEG) and electrooculogram (EOG) recordings provide complementary information for sleep analysis; however, most existing multimodal approaches rely on simple feature concatenation, which limits their ability to capture structured inter-modality relationships. This paper proposes MFSleepNet, a multimodal sleep staging framework that explicitly models interactions between EEG and EOG signals. The proposed system incorporates a multimodal feature fusion module to enable bidirectional information exchange between modality-specific representations, followed by a gated temporal-channel attention mechanism to adaptively emphasize informative temporal segments and signal channels, facilitating joint representation learning while preserving modality-specific characteristics. Experiments on three public datasets (Sleep-EDF, SHHS, and HSP) under an epoch-level cross-validation protocol show that MFSleepNet consistently outperforms representative single-modality and multimodal baseline methods in terms of overall accuracy, Cohen’s κ, and Macro-F1. Ablation studies further demonstrate the contribution of each functional module. Correlation analysis indicates stage-dependent variations in EEG–EOG relationships, while interaction-based experiments show that explicit feature interaction improves both joint and modality-specific representations. Grad-CAM visualizations provide interpretability of model decisions. External validation on unseen subjects reveals a noticeable performance drop, highlighting the challenges of inter-subject variability and the limited baseline generalization capability of the model. To address this, a lightweight subject-specific adaptation strategy is introduced, which improves performance using a small amount of labeled subject-specific data. Overall, the proposed framework provides an effective and interpretable solution for multimodal sleep staging while emphasizing the importance of structured inter-modality interaction and subject-adaptive modeling in practical applications.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Sleep StagesHumansElectroencephalographyElectrooculographySignal Processing, Computer-AssistedAlgorithms

Stichwörter der Autor:innen

EEG and EOG fusionmultimodal learningphysiological signal processingsleep stagingsubject-specific adaptation

Autor:innen und Institutionen

  • School of Electronic and Electrical Engineering, Zhengzhou University of Science and Technology, Zhengzhou 450064, China.
  • College of Electrical Engineering, Henan University of Technology, Zhengzhou 450001, China.

ORCID-Profile: Qunfeng Niu

Förderung

  • the Key Research and Development Special Fund of Henan Province
  • Open Project of Henan University of Technology Institute for Complexity Science

Zitieren

APA

Gui, R., Wang, C., Niu, Q., & Wang, L. (2026). MFSleepNet: An Interactive Multimodal Fusion Framework for Automatic Sleep Staging. Sensors. https://doi.org/10.3390/s26103085

Vancouver

Gui R, Wang C, Niu Q, Wang L. MFSleepNet: An Interactive Multimodal Fusion Framework for Automatic Sleep Staging. Sensors. 2026. doi:10.3390/s26103085

BibTeX
@article{Gui2026,
  author = {Gui, Ranran and Wang, Chen and Niu, Qunfeng and Wang, Li},
  title = {MFSleepNet: An Interactive Multimodal Fusion Framework for Automatic Sleep Staging},
  journal = {Sensors},
  year = {2026},
  doi = {10.3390/s26103085}
}
Kostenlos starten →