How to Get Enriched Metadata? A Multi‐modal Model Fusion Strategy for Automatic Metadata Enhancement in GLAM Art Collections
Proceedings of the Association for Information Science and Technology · 2025-10 · 62 (1) · 1093-1098
DOI: 10.1002/pra2.1345 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the Association for Information Science and Technology, online erschienen am 16.10.2025. Verfasst von Zhihan Sun und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 24 Literaturangaben.
Abstract (Originalsprache)
Cultural heritage resource metadata is the foundation and precious asset for GLAM institutions to provide knowledge services which enables users to efficiently search relevant collection information. However, current GLAM institutions (e.g. museums), face significant challenges to gather comprehensive high‐quality collection metadata. Motivated by the complementary advantages of multi‐modal large language models (MLLMs) and pretrained small ones (MPSMs), we proposed “AGGM”, a model fusion approach for automatic metadata enrichment including two key components: MPSM‐based module for demonstration detection and MLLM‐based module for prediction calibration. The merit of AGGM is to fully leverage the powerful semantic understanding capabilities to generate accurate results based on MLLMs in limited computation cost, and also exert the strength of MPSM domain‐specific knowledge to obtain informative demonstrations. The experimental results showed that AGGM outperformed baseline models in two regular metadata generation tasks, demonstrating enormous potential of this proposed model fusion approach in automatic generation of GLAM metadata.
Zitieren
APA
Sun, Z., Yan, C., & Zeng, Y. (2025). How to Get Enriched Metadata? A Multi‐modal Model Fusion Strategy for Automatic Metadata Enhancement in GLAM Art Collections. Proceedings of the Association for Information Science and Technology, 62(1), 1093-1098. https://doi.org/10.1002/pra2.1345
Vancouver
Sun Z, Yan C, Zeng Y. How to Get Enriched Metadata? A Multi‐modal Model Fusion Strategy for Automatic Metadata Enhancement in GLAM Art Collections. Proceedings of the Association for Information Science and Technology. 2025;62(1):1093-1098. doi:10.1002/pra2.1345
BibTeX
@article{Sun2025,
author = {Sun, Zhihan and Yan, Chengxi and Zeng, Yurong},
title = {How to Get Enriched Metadata? A Multi‐modal Model Fusion Strategy for Automatic Metadata Enhancement in GLAM Art Collections},
journal = {Proceedings of the Association for Information Science and Technology},
year = {2025},
volume = {62},
number = {1},
pages = {1093--1098},
doi = {10.1002/pra2.1345}
}
EUVIMED