GOMFuNet: A Geometric Orthogonal Multimodal Fusion Network for Enhanced Prediction Reliability
Mathematics · 27.05.2025 · 13 (11) · 1791
DOI: 10.3390/math13111791 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics, online erschienen am 27.05.2025. Verfasst von Yi Guo und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: 2023 Guangdong Undergraduate Colleges and UniversitiesTeaching Quality and Teaching Reform Program of Construction Project: Exploration and Practice of INSPIRE….
Abstract (Originalsprache)
Integrating information from heterogeneous data sources poses significant mathematical challenges, particularly in ensuring the reliability and reducing the uncertainty of predictive models. This paper introduces the Geometric Orthogonal Multimodal Fusion Network (GOMFuNet), a novel mathematical framework designed to address these challenges. GOMFuNet synergistically combines two core mathematical principles: (1) It utilizes geometric deep learning, specifically Graph Convolutional Networks (GCNs), within its Cross-Modal Label Fusion Module (CLFM) to perform fusion in a high-level semantic label space, thereby preserving inter-sample topological relationships and enhancing robustness to inconsistencies. (2) It incorporates a novel Label Confidence Learning Module (LCLM) derived from optimization theory, which explicitly enhances prediction reliability by enforcing mathematical orthogonality among the predicted class probability vectors, directly minimizing output uncertainty. We demonstrate GOMFuNet’s effectiveness through comprehensive experiments, including confidence calibration analysis and robustness tests, and validate its practical utility via a case study on educational performance prediction using structured, textual, and audio data. Results show GOMFuNet achieves significantly improved performance (90.17% classification accuracy, 88.03% R2 regression) and enhanced reliability compared to baseline and state-of-the-art multimodal methods, validating its potential as a robust framework for reliable multimodal learning.
Förderung
- 2023 Guangdong Undergraduate Colleges and UniversitiesTeaching Quality and Teaching Reform Program of Construction Project: Exploration and Practice of INSPIRE…
Zitieren
APA
Guo, Y., & Zhong, R. (2025). GOMFuNet: A Geometric Orthogonal Multimodal Fusion Network for Enhanced Prediction Reliability. Mathematics, 13(11), 1791. https://doi.org/10.3390/math13111791
Vancouver
Guo Y, Zhong R. GOMFuNet: A Geometric Orthogonal Multimodal Fusion Network for Enhanced Prediction Reliability. Mathematics. 2025;13(11):1791. doi:10.3390/math13111791
BibTeX
@article{Guo2025,
author = {Guo, Yi and Zhong, Rui},
title = {GOMFuNet: A Geometric Orthogonal Multimodal Fusion Network for Enhanced Prediction Reliability},
journal = {Mathematics},
year = {2025},
volume = {13},
number = {11},
pages = {1791},
doi = {10.3390/math13111791}
}
EUVIMED