Online Cross-modal Hashing With Dynamic Prototype
ACM Transactions on Multimedia Computing, Communications, and Applications · 31.08.2024 · 20 (8) · 1-18
DOI: 10.1145/3665249 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 13.06.2024. Verfasst von Xiao Kang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 54 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Shandong Province, Major Basic Research Project of Natural Science Foundation of Shandong Province.
Abstract (Originalsprache)
Online cross-modal hashing has received increasing attention due to its efficiency and effectiveness in handling cross-modal streaming data retrieval. Despite the promising performance, these methods mainly focus on the supervised learning paradigm, demanding expensive and laborious work to obtain clean annotated data. Existing unsupervised online hashing methods mostly struggle to construct instructive semantic correlations among data chunks, resulting in the forgetting of accumulated data distribution. To this end, we propose a Dynamic Prototype-based Online Cross-modal Hashing method, called DPOCH. Based on the pre-learned reliable common representations, DPOCH generates prototypes incrementally as sketches of accumulated data and updates them dynamically for adapting streaming data. Thereafter, the prototype-based semantic embedding and similarity graphs are designed to promote stability and generalization of the hashing process, thereby obtaining globally adaptive hash codes and hash functions. Experimental results on benchmarked datasets demonstrate that the proposed DPOCH outperforms state-of-the-art unsupervised online cross-modal hashing methods.
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Shandong Province
- Major Basic Research Project of Natural Science Foundation of Shandong Province
- Taishan Scholar Project of Shandong Province
- Shandong Provincial Natural Science Foundation for Distinguished Young Scholars
Zitieren
APA
Kang, X., Liu, X., Xue, W., Nie, X., & Yin, Y. (2024). Online Cross-modal Hashing With Dynamic Prototype. ACM Transactions on Multimedia Computing, Communications, and Applications, 20(8), 1-18. https://doi.org/10.1145/3665249
Vancouver
Kang X, Liu X, Xue W, Nie X, Yin Y. Online Cross-modal Hashing With Dynamic Prototype. ACM Transactions on Multimedia Computing, Communications, and Applications. 2024;20(8):1-18. doi:10.1145/3665249
BibTeX
@article{Kang2024,
author = {Kang, Xiao and Liu, Xingbo and Xue, Wen and Nie, Xiushan and Yin, Yilong},
title = {Online Cross-modal Hashing With Dynamic Prototype},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2024},
volume = {20},
number = {8},
pages = {1--18},
doi = {10.1145/3665249}
}
EUVIMED