Multimodal representation learning for tourism recommendation with two-tower architecture
PLOS ONE · 2024
DOI: 10.1371/journal.pone.0299370 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS ONE, 2024. Verfasst von Yuhang Cui und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Software, Henan University, Kaifeng, China. Hauptthemen laut MEDLINE: Tourism, Learning. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: FDCT Funding Scheme for Postdoctoral Researchers of Higher Education Institutions.
Abstract (Originalsprache)
Personalized recommendation plays an important role in many online service fields. In the field of tourism recommendation, tourist attractions contain rich context and content information. These implicit features include not only text, but also images and videos. In order to make better use of these features, researchers usually introduce richer feature information or more efficient feature representation methods, but the unrestricted introduction of a large amount of feature information will undoubtedly reduce the performance of the recommendation system. We propose a novel heterogeneous multimodal representation learning method for tourism recommendation. The proposed model is based on two-tower architecture, in which the item tower handles multimodal latent features: Bidirectional Long Short-Term Memory (Bi-LSTM) is used to extract the text features of items, and an External Attention Transformer (EANet) is used to extract image features of items, and connect these feature vectors with item IDs to enrich the feature representation of items. In order to increase the expressiveness of the model, we introduce a deep fully connected stack layer to fuse multimodal feature vectors and capture the hidden relationship between them. The model is tested on the three different datasets, our model is better than the baseline models in NDCG and precision.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- School of Software, Henan University, Kaifeng, China.
- Institute for Data Engineering and Science, University of Saint Joseph, Macau, China.
ORCID-Profile: Yuhang Cui, Shengbin Liang
Förderung
- FDCT Funding Scheme for Postdoctoral Researchers of Higher Education Institutions
Zitieren
APA
Cui, Y., Liang, S., & Zhang, Y. (2024). Multimodal representation learning for tourism recommendation with two-tower architecture. PLOS ONE. https://doi.org/10.1371/journal.pone.0299370
Vancouver
Cui Y, Liang S, Zhang Y. Multimodal representation learning for tourism recommendation with two-tower architecture. PLOS ONE. 2024. doi:10.1371/journal.pone.0299370
BibTeX
@article{Cui2024,
author = {Cui, Yuhang and Liang, Shengbin and Zhang, YuYing},
title = {Multimodal representation learning for tourism recommendation with two-tower architecture},
journal = {PLOS ONE},
year = {2024},
doi = {10.1371/journal.pone.0299370}
}
EUVIMED