Multi-Label Weighted Contrastive Cross-Modal Hashing
Applied Sciences · 21.12.2023 · 14 (1) · 93
DOI: 10.3390/app14010093 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 21.12.2023. Verfasst von Zeqian Yi und 5 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 70 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Hunan Province, Scientific Research Project of Hunan Provincial Department of Education.
Abstract (Originalsprache)
Due to the low storage cost and high computation efficiency of hashing, cross-modal hashing has been attracting widespread attention in recent years. In this paper, we investigate how supervised cross-modal hashing (CMH) benefits from multi-label and contrastive learning (CL) by overcoming the following two challenges: (i) how to combine multi-label and supervised contrastive learning to consider diverse relationships among cross-modal instances, and (ii) how to reduce the sparsity of multi-label representation so as to improve the similarity measurement accuracy. To this end, we propose a novel cross-modal hashing framework, dubbed Multi-Label Weighted Contrastive Hashing (MLWCH). This framework involves compact consistent similarity representation, a new designed multi-label similarity calculation method that efficiently reduces the sparsity of multi-label by reducing redundant zero elements. Furthermore, a novel multi-label weighted contrastive learning strategy is developed to significantly improve hashing learning by assigning similarity weight to positive samples under both linear and non-linear similarities. Extensive experiments and ablation analysis over three benchmark datasets validate the superiority of our MLWCH method, especially over several outstanding baselines.
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Hunan Province
- Scientific Research Project of Hunan Provincial Department of Education
- Key Research and Development Program of Hunan Province
Zitieren
APA
Yi, Z., Zhu, X., Wu, R., Zou, Z., Liu, Y., & Zhu, L. (2023). Multi-Label Weighted Contrastive Cross-Modal Hashing. Applied Sciences, 14(1), 93. https://doi.org/10.3390/app14010093
Vancouver
Yi Z, Zhu X, Wu R, Zou Z, Liu Y, Zhu L. Multi-Label Weighted Contrastive Cross-Modal Hashing. Applied Sciences. 2023;14(1):93. doi:10.3390/app14010093
BibTeX
@article{Yi2023,
author = {Yi, Zeqian and Zhu, Xinghui and Wu, Runbing and Zou, Zhuoyang and Liu, Yi and Zhu, Lei},
title = {Multi-Label Weighted Contrastive Cross-Modal Hashing},
journal = {Applied Sciences},
year = {2023},
volume = {14},
number = {1},
pages = {93},
doi = {10.3390/app14010093}
}
EUVIMED