Cross-modal retrieval based on multi-dimensional feature fusion hashing
Frontiers in Physics · 19.06.2024 · 12
DOI: 10.3389/fphy.2024.1379873 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Physics, online erschienen am 19.06.2024. Verfasst von Dongxiao Ren und 1 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Along with the continuous breakthrough and popularization of information network technology, multi-modal data, including texts, images, videos, and audio, is growing rapidly. We can retrieve different modal data to meet our needs, so cross-modal retrieval has important theoretical significance and application value. In addition, because the data of different modalities can be mutually retrieved by mapping them to a unified Hamming space, hash codes have been extensively used in the cross-modal retrieval field. However, existing cross-modal hashing models generate hash codes based on single-dimension data features, ignoring the semantic correlation between data features in different dimensions. Therefore, an innovative cross-modal retrieval method using Multi-Dimensional Feature Fusion Hashing (MDFFH) is proposed. To better get the image’s multi-dimensional semantic features, a convolutional neural network, and Vision Transformer are combined to construct an image multi-dimensional fusion module. Similarly, we apply the multi-dimensional text fusion module to the text modality to obtain the text’s multi-dimensional semantic features. These two modules can effectively integrate the semantic features of data in different dimensions through feature fusion, making the generated hash code more representative and semantic. Extensive experiments and corresponding analysis results on two datasets indicate that MDFFH’s performance outdoes other baseline models.
Zitieren
APA
Ren, D., & Xu, W. (2024). Cross-modal retrieval based on multi-dimensional feature fusion hashing. Frontiers in Physics, 12. https://doi.org/10.3389/fphy.2024.1379873
Vancouver
Ren D, Xu W. Cross-modal retrieval based on multi-dimensional feature fusion hashing. Frontiers in Physics. 2024;12. doi:10.3389/fphy.2024.1379873
BibTeX
@article{Ren2024,
author = {Ren, Dongxiao and Xu, Weihua},
title = {Cross-modal retrieval based on multi-dimensional feature fusion hashing},
journal = {Frontiers in Physics},
year = {2024},
volume = {12},
doi = {10.3389/fphy.2024.1379873}
}
EUVIMED