MM-HGNN: Multimodal Representation Learning Heterogeneous Graph Neural Network
International Journal of Computational Intelligence Systems · 11.07.2025 · 18 (1)
DOI: 10.1007/s44196-025-00820-9 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computational Intelligence Systems, online erschienen am 11.07.2025. Verfasst von Khalil Bachiri und 3 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Multimodal learning heterogeneous graphs are very challenging because of the diverse structures and data modalities. The existing graph neural networks cannot efficiently capture both the multimodality of the data and the inherent heterogeneity of such graphs. In this paper, we propose Multimodal Representation Learning Heterogeneous Graph Neural network (MM-HGNN) to tackle these challenges. MM-HGNN introduces a novel Modality Transferability Function to quantify the heterogeneity between different modalities, which allows the model to dynamically adjust the attention scores and give precedence to unique information that is non-redundant. Additionally, it integrates modality-level attention that distributes attention in an adaptive way over different modalities according to their relevance, enhancing feature representations for tasks such as node classification. To further improve representation learning, a splicing mechanism is proposed to integrate outputs from multiple network layers, combining high-level features for more expressive node embeddings. We validate the effectiveness of MM-HGNN through extensive experiments on the IMDB and Amazon datasets. Our model outperforms several state-of-the-art methods under the Macro-F1, Micro-F1, and AUC metrics by a large margin, which well demonstrates its strong capability in dealing with the challenging multimodal and heterogeneous data. Comprehensive ablation studies further emphasize the contributions of each key component in improving the overall performance.
Zitieren
APA
Bachiri, K., Yahyaouy, A., Malek, M., & Rogovschi, N. (2025). MM-HGNN: Multimodal Representation Learning Heterogeneous Graph Neural Network. International Journal of Computational Intelligence Systems, 18(1). https://doi.org/10.1007/s44196-025-00820-9
Vancouver
Bachiri K, Yahyaouy A, Malek M, Rogovschi N. MM-HGNN: Multimodal Representation Learning Heterogeneous Graph Neural Network. International Journal of Computational Intelligence Systems. 2025;18(1). doi:10.1007/s44196-025-00820-9
BibTeX
@article{Bachiri2025,
author = {Bachiri, Khalil and Yahyaouy, Ali and Malek, Maria and Rogovschi, Nicoleta},
title = {MM-HGNN: Multimodal Representation Learning Heterogeneous Graph Neural Network},
journal = {International Journal of Computational Intelligence Systems},
year = {2025},
volume = {18},
number = {1},
doi = {10.1007/s44196-025-00820-9}
}
EUVIMED