EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhanced-Similarity Attention Fusion for Unsupervised Cross-Modal Hashing Retrieval

Mingyong Li, Mingyuan Ge

Data Science and Engineering · 2025-06 · 10 (2) · 258-276

DOI: 10.1007/s41019-024-00274-7 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Data Science and Engineering, online erschienen am 30.01.2025. Verfasst von Mingyong Li und 1 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of Chongqing Municipality, Science and Technology Research Program of Chongqing Municipal Education Commission.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Although the fact that current methods have some effects, unsupervised cross-modal hashing methods still face several common challenges. First of all, the text features that have been collected from text data are not comprehensive enough to provide sufficient guidance for building textual modal similarity matrices. Secondly, the fusion of similarity matrices from different modalities lacks adaptability, leading to a less accurate final similarity matrix. This work suggests Enhanced Similarity Attention Fusion Hashing (ESAFH) as a remedy for these problems. Firstly, we construct a text encoder to enrich text features, an adjacency matrix is built to represent the association relationship between pairs of samples. Additionally, it is thought that features can be extracted from the sample and its semantic neighbor samples to enhance text features. Furthermore, we enhance the original similarity matrix by incorporating related information. This step aims to improve the accuracy of similarity estimation by considering the enriched text features obtained in the previous step. Finally, we introduce an enhanced attention fusion mechanism. This mechanism adaptively fuses the similarity matrices from different modalities, creating a unified inter-modal similarity matrix. This fused matrix guides the learning of hash functions by preserving the most relevant information from each modality. Through comprehensive experiments on the three popular datasets, the suggested ESAFH method is thoroughly assessed. The findings show that on these datasets, ESAFH performs satisfactorily in cross-modal retrieval tasks. In conclusion, by boosting text features, improving the similarity matrix, and utilizing an attention fusion mechanism, ESAFH solves the shortcomings of current methods.

Förderung

  • Natural Science Foundation of Chongqing Municipality
  • Science and Technology Research Program of Chongqing Municipal Education Commission

Zitieren

APA

Li, M., & Ge, M. (2025). Enhanced-Similarity Attention Fusion for Unsupervised Cross-Modal Hashing Retrieval. Data Science and Engineering, 10(2), 258-276. https://doi.org/10.1007/s41019-024-00274-7

Vancouver

Li M, Ge M. Enhanced-Similarity Attention Fusion for Unsupervised Cross-Modal Hashing Retrieval. Data Science and Engineering. 2025;10(2):258-276. doi:10.1007/s41019-024-00274-7

BibTeX
@article{Li2025,
  author = {Li, Mingyong and Ge, Mingyuan},
  title = {Enhanced-Similarity Attention Fusion for Unsupervised Cross-Modal Hashing Retrieval},
  journal = {Data Science and Engineering},
  year = {2025},
  volume = {10},
  number = {2},
  pages = {258--276},
  doi = {10.1007/s41019-024-00274-7}
}
Kostenlos starten →