Multiple Information Embedded Hashing for Large-Scale Cross-Modal Retrieval
IEEE Transactions on Circuits and Systems for Video Technology · 2024-06 · 34 (6) · 5118-5131
DOI: 10.1109/tcsvt.2023.3340102 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-06. Verfasst von Yongxin Wang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 58 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Shandong Province, Shandong Provincial Key Research and Development Program.
Abstract (Originalsprache)
Recently, many efforts have been devoted to improving the retrieval performance of supervised cross-modal hashing; however, current methods are gradually reaching a performance bottleneck, especially when dealing with real-world multimedia data. This is mainly due to their application of coarse-grained semantics, unrobust hash functions, and inflexible workflows. Therefore, discovering refined semantics hidden in data, designing robust hash functions, and creating a non-interfering but facilitative learning workflow are much more significant. With this motivation, in this paper, we propose a novel supervised cross-modal hashing method, i.e., Multiple Information Embedded Hashing, MIEH for short. It consists of a three-step working flow that flexibly handles multiple information mining, hash code learning, and hash function learning. First, it explores the multimedia data from multiple perspectives such as modal-level consistency, class-level discriminability, and instance-level similarity to mine comprehensive semantic information, which not only contributes to the generation of discriminative hash codes, but also accelerates convergence. Subsequently, MIEH is committed to embed the refined semantics into targeted hash codes with an efficient discrete optimization algorithm. Finally, it improves the learning ability of linear hash function by noisy example erasing and deviation correcting. Considering this, MIEH is able to garner more robust hash function. Extensive experiments conducted on three popular benchmark datasets highlight the superiority of our MIEH on large-scale cross-modal retrieval tasks and demonstrate its competitive performance against state-of-the-art approaches. The source code is available at https://github.com/yxinwang/MIEH.
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Shandong Province
- Shandong Provincial Key Research and Development Program
- Special Funds for Distinguished Associate Professors of Shandong Jianzhu University
- Young Scholars Program of Shandong University
Zitieren
APA
Wang, Y., Zhan, Y., Chen, Z., Luo, X., & Xu, X. (2024). Multiple Information Embedded Hashing for Large-Scale Cross-Modal Retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 34(6), 5118-5131. https://doi.org/10.1109/tcsvt.2023.3340102
Vancouver
Wang Y, Zhan Y, Chen Z, Luo X, Xu X. Multiple Information Embedded Hashing for Large-Scale Cross-Modal Retrieval. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(6):5118-5131. doi:10.1109/tcsvt.2023.3340102
BibTeX
@article{Wang2024,
author = {Wang, Yongxin and Zhan, Yu-Wei and Chen, Zhen-Duo and Luo, Xin and Xu, Xin-Shun},
title = {Multiple Information Embedded Hashing for Large-Scale Cross-Modal Retrieval},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2024},
volume = {34},
number = {6},
pages = {5118--5131},
doi = {10.1109/tcsvt.2023.3340102}
}
EUVIMED