EUVIMEDEUVIMED entdecken
Crossref

Multiple Information Embedded Hashing for Large-Scale Cross-Modal Retrieval

Yongxin Wang, Yu-Wei Zhan, Zhen-Duo Chen, Xin Luo, Xin-Shun Xu

IEEE Transactions on Circuits and Systems for Video Technology · 2024-06 · 34 (6) · 5118-5131

DOI: 10.1109/tcsvt.2023.3340102 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-06. Verfasst von Yongxin Wang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 58 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Shandong Province, Shandong Provincial Key Research and Development Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recently, many efforts have been devoted to improving the retrieval performance of supervised cross-modal hashing; however, current methods are gradually reaching a performance bottleneck, especially when dealing with real-world multimedia data. This is mainly due to their application of coarse-grained semantics, unrobust hash functions, and inflexible workflows. Therefore, discovering refined semantics hidden in data, designing robust hash functions, and creating a non-interfering but facilitative learning workflow are much more significant. With this motivation, in this paper, we propose a novel supervised cross-modal hashing method, i.e., Multiple Information Embedded Hashing, MIEH for short. It consists of a three-step working flow that flexibly handles multiple information mining, hash code learning, and hash function learning. First, it explores the multimedia data from multiple perspectives such as modal-level consistency, class-level discriminability, and instance-level similarity to mine comprehensive semantic information, which not only contributes to the generation of discriminative hash codes, but also accelerates convergence. Subsequently, MIEH is committed to embed the refined semantics into targeted hash codes with an efficient discrete optimization algorithm. Finally, it improves the learning ability of linear hash function by noisy example erasing and deviation correcting. Considering this, MIEH is able to garner more robust hash function. Extensive experiments conducted on three popular benchmark datasets highlight the superiority of our MIEH on large-scale cross-modal retrieval tasks and demonstrate its competitive performance against state-of-the-art approaches. The source code is available at https://github.com/yxinwang/MIEH.

Förderung

  • National Natural Science Foundation of China
  • Natural Science Foundation of Shandong Province
  • Shandong Provincial Key Research and Development Program
  • Special Funds for Distinguished Associate Professors of Shandong Jianzhu University
  • Young Scholars Program of Shandong University

Zitieren

APA

Wang, Y., Zhan, Y., Chen, Z., Luo, X., & Xu, X. (2024). Multiple Information Embedded Hashing for Large-Scale Cross-Modal Retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 34(6), 5118-5131. https://doi.org/10.1109/tcsvt.2023.3340102

Vancouver

Wang Y, Zhan Y, Chen Z, Luo X, Xu X. Multiple Information Embedded Hashing for Large-Scale Cross-Modal Retrieval. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(6):5118-5131. doi:10.1109/tcsvt.2023.3340102

BibTeX
@article{Wang2024,
  author = {Wang, Yongxin and Zhan, Yu-Wei and Chen, Zhen-Duo and Luo, Xin and Xu, Xin-Shun},
  title = {Multiple Information Embedded Hashing for Large-Scale Cross-Modal Retrieval},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2024},
  volume = {34},
  number = {6},
  pages = {5118--5131},
  doi = {10.1109/tcsvt.2023.3340102}
}
Kostenlos starten →