EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

GOMFuNet: A Geometric Orthogonal Multimodal Fusion Network for Enhanced Prediction Reliability

Yi Guo, Rui Zhong

Mathematics · 27.05.2025 · 13 (11) · 1791

DOI: 10.3390/math13111791 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematics, online erschienen am 27.05.2025. Verfasst von Yi Guo und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: 2023 Guangdong Undergraduate Colleges and UniversitiesTeaching Quality and Teaching Reform Program of Construction Project: Exploration and Practice of INSPIRE….

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Integrating information from heterogeneous data sources poses significant mathematical challenges, particularly in ensuring the reliability and reducing the uncertainty of predictive models. This paper introduces the Geometric Orthogonal Multimodal Fusion Network (GOMFuNet), a novel mathematical framework designed to address these challenges. GOMFuNet synergistically combines two core mathematical principles: (1) It utilizes geometric deep learning, specifically Graph Convolutional Networks (GCNs), within its Cross-Modal Label Fusion Module (CLFM) to perform fusion in a high-level semantic label space, thereby preserving inter-sample topological relationships and enhancing robustness to inconsistencies. (2) It incorporates a novel Label Confidence Learning Module (LCLM) derived from optimization theory, which explicitly enhances prediction reliability by enforcing mathematical orthogonality among the predicted class probability vectors, directly minimizing output uncertainty. We demonstrate GOMFuNet’s effectiveness through comprehensive experiments, including confidence calibration analysis and robustness tests, and validate its practical utility via a case study on educational performance prediction using structured, textual, and audio data. Results show GOMFuNet achieves significantly improved performance (90.17% classification accuracy, 88.03% R2 regression) and enhanced reliability compared to baseline and state-of-the-art multimodal methods, validating its potential as a robust framework for reliable multimodal learning.

Förderung

  • 2023 Guangdong Undergraduate Colleges and UniversitiesTeaching Quality and Teaching Reform Program of Construction Project: Exploration and Practice of INSPIRE…

Zitieren

APA

Guo, Y., & Zhong, R. (2025). GOMFuNet: A Geometric Orthogonal Multimodal Fusion Network for Enhanced Prediction Reliability. Mathematics, 13(11), 1791. https://doi.org/10.3390/math13111791

Vancouver

Guo Y, Zhong R. GOMFuNet: A Geometric Orthogonal Multimodal Fusion Network for Enhanced Prediction Reliability. Mathematics. 2025;13(11):1791. doi:10.3390/math13111791

BibTeX
@article{Guo2025,
  author = {Guo, Yi and Zhong, Rui},
  title = {GOMFuNet: A Geometric Orthogonal Multimodal Fusion Network for Enhanced Prediction Reliability},
  journal = {Mathematics},
  year = {2025},
  volume = {13},
  number = {11},
  pages = {1791},
  doi = {10.3390/math13111791}
}
Kostenlos starten →