Unsupervised Heterogeneous Graph Neural Networks for One-Class Tasks: Exploring Early Fusion Operators
Journal on Interactive Systems · 29.05.2024 · 15 (1) · 517-529
DOI: 10.5753/jis.2024.4109 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal on Interactive Systems, online erschienen am 29.05.2024. Verfasst von Marcos Paulo Silva Gôlo und 3 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Heterogeneous graphs are an essential structure that models real-world data through different types of nodes and relationships between them, including multimodality, which comprises different types of data such as text, image, and audio. Graph Neural Networks (GNNs) are a prominent graph representation learning method that takes advantage of the graph structure and its attributes that, when applied to the multimodal heterogeneous graph, learn a unique semantic space for the different modalities. Consequently, it allows multimodal fusion through simple operators such as sum, average, or multiplication, generating unified representations considering the supplementary and complementarity relationships between the modalities. In multimodal heterogeneous graphs, the labeling process tends to be even more costly due to the multiple modalities analyzed, in addition to the imbalance of classes inherent to some applications. In order to overcome these problems in applications that comprise a class of interest, One-Class Learning (OCL) is used. Given the lack of studies on multimodal early fusion in heterogeneous graphs for OCL tasks, we proposed a method based on unsupervised GNN for heterogeneous graphs and evaluated different early fusion operators. In this paper, we extend another work by evaluating the behavior of the main GNN convolutions in the method. We highlight that using operators such as average, addition, and subtraction were the best early fusion operators. In addition, GNN layers that do not use an attention mechanism performed better. In this way, we argue for heterogeneous graph neural networks in multimodal using early fusion simple operators instead of well-often-used concatenation and less complex convolutions.
Zitieren
APA
Gôlo, M. P. S., Junior, M. I. D. M., Goularte, R., & Marcacini, R. M. (2024). Unsupervised Heterogeneous Graph Neural Networks for One-Class Tasks: Exploring Early Fusion Operators. Journal on Interactive Systems, 15(1), 517-529. https://doi.org/10.5753/jis.2024.4109
Vancouver
Gôlo MPS, Junior MIDM, Goularte R, Marcacini RM. Unsupervised Heterogeneous Graph Neural Networks for One-Class Tasks: Exploring Early Fusion Operators. Journal on Interactive Systems. 2024;15(1):517-529. doi:10.5753/jis.2024.4109
BibTeX
@article{Glo2024,
author = {Gôlo, Marcos Paulo Silva and Junior, Marcelo Isaias De Moraes and Goularte, Rudinei and Marcacini, Ricardo Marcondes},
title = {Unsupervised Heterogeneous Graph Neural Networks for One-Class Tasks: Exploring Early Fusion Operators},
journal = {Journal on Interactive Systems},
year = {2024},
volume = {15},
number = {1},
pages = {517--529},
doi = {10.5753/jis.2024.4109}
}
EUVIMED