EUVIMEDEUVIMED entdecken
Crossref

A Survey of Multi-modal Knowledge Graphs: Technologies and Trends

Wanying Liang, Pasquale De Meo, Yong Tang, Jia Zhu

ACM Computing Surveys · 30.11.2024 · 56 (11) · 1-41

DOI: 10.1145/3656579 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 28.06.2024. Verfasst von Wanying Liang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 100-mal zitiert (Crossref) und nennt 121 Literaturangaben. Gefördert von: Research and Demonstration Application of Key Technologies for Personalized Learning Driven by Educational Big Data, National Key R&D Program of China, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In recent years, Knowledge Graphs (KGs) have played a crucial role in the development of advanced knowledge-intensive applications, such as recommender systems and semantic search. However, the human sensory system is inherently multi-modal, as objects around us are often represented by a combination of multiple signals, such as visual and textual. Consequently, Multi-modal Knowledge Graphs (MMKGs), which combine structured knowledge representation with multiple modalities, represent a powerful extension of KGs. Although MMKGs can handle certain types of tasks (e.g., visual query answering) or queries that standard KGs cannot process, and they can effectively tackle some standard problems (e.g., entity alignment), we lack a widely accepted definition of MMKG. In this survey, we provide a rigorous definition of MMKGs along with a classification scheme based on how existing approaches address four fundamental challenges: representation, fusion, alignment, and translation, which are crucial to improving an MMKG. Our classification scheme is flexible and allows for easy incorporation of new approaches, as well as a comparison of two approaches in terms of how they address one of the fundamental challenges mentioned above. As the first comprehensive survey of MMKG, this article aims at inspiring and provide a reference for relevant researchers in the field of Artificial Intelligence.

Förderung

  • Research and Demonstration Application of Key Technologies for Personalized Learning Driven by Educational Big Data
  • National Key R&D Program of China
  • National Natural Science Foundation of China

Zitieren

APA

Liang, W., Meo, P. D., Tang, Y., & Zhu, J. (2024). A Survey of Multi-modal Knowledge Graphs: Technologies and Trends. ACM Computing Surveys, 56(11), 1-41. https://doi.org/10.1145/3656579

Vancouver

Liang W, Meo PD, Tang Y, Zhu J. A Survey of Multi-modal Knowledge Graphs: Technologies and Trends. ACM Computing Surveys. 2024;56(11):1-41. doi:10.1145/3656579

BibTeX
@article{Liang2024,
  author = {Liang, Wanying and Meo, Pasquale De and Tang, Yong and Zhu, Jia},
  title = {A Survey of Multi-modal Knowledge Graphs: Technologies and Trends},
  journal = {ACM Computing Surveys},
  year = {2024},
  volume = {56},
  number = {11},
  pages = {1--41},
  doi = {10.1145/3656579}
}
Kostenlos starten →