EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Graph neural networks in vision-language image understanding: a survey

Henry Senior, Gregory Slabaugh, Shanxin Yuan, Luca Rossi

The Visual Computer · 2025-01 · 41 (1) · 491-516

DOI: 10.1007/s00371-024-03343-0 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Visual Computer, online erschienen am 29.03.2024. Verfasst von Henry Senior und 3 weiteren Autor:innen. Die Arbeit wurde bisher 32-mal zitiert (Crossref) und nennt 156 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Engineering and Physical Sciences Research Council.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

2D image understanding is a complex problem within computer vision, but it holds the key to providing human-level scene comprehension. It goes further than identifying the objects in an image, and instead, it attempts to understand the scene. Solutions to this problem form the underpinning of a range of tasks, including image captioning, visual question answering (VQA), and image retrieval. Graphs provide a natural way to represent the relational arrangement between objects in an image, and thus, in recent years graph neural networks (GNNs) have become a standard component of many 2D image understanding pipelines, becoming a core architectural component, especially in the VQA group of tasks. In this survey, we review this rapidly evolving field and we provide a taxonomy of graph types used in 2D image understanding approaches, a comprehensive list of the GNN models used in this domain, and a roadmap of future potential developments. To the best of our knowledge, this is the first comprehensive survey that covers image captioning, visual question answering, and image retrieval techniques that focus on using GNNs as the main part of their architecture.

Förderung

  • Engineering and Physical Sciences Research Council

Zitieren

APA

Senior, H., Slabaugh, G., Yuan, S., & Rossi, L. (2025). Graph neural networks in vision-language image understanding: a survey. The Visual Computer, 41(1), 491-516. https://doi.org/10.1007/s00371-024-03343-0

Vancouver

Senior H, Slabaugh G, Yuan S, Rossi L. Graph neural networks in vision-language image understanding: a survey. The Visual Computer. 2025;41(1):491-516. doi:10.1007/s00371-024-03343-0

BibTeX
@article{Senior2025,
  author = {Senior, Henry and Slabaugh, Gregory and Yuan, Shanxin and Rossi, Luca},
  title = {Graph neural networks in vision-language image understanding: a survey},
  journal = {The Visual Computer},
  year = {2025},
  volume = {41},
  number = {1},
  pages = {491--516},
  doi = {10.1007/s00371-024-03343-0}
}
Kostenlos starten →