Online Cross-modal Hashing With Dynamic Prototype
ACM Transactions on Multimedia Computing, Communications, and Applications · 2024-08-31 · 20 (8) · 1-18
DOI: 10.1145/3665249 ↗At a glance
Journal article in ACM Transactions on Multimedia Computing, Communications, and Applications, published online on 2024-06-13. Written by Xiao Kang and 4 co-authors. Cited 11 times so far (Crossref); 54 references. Funded by: National Natural Science Foundation of China, Natural Science Foundation of Shandong Province, Major Basic Research Project of Natural Science Foundation of Shandong Province.
Abstract (original language)
Online cross-modal hashing has received increasing attention due to its efficiency and effectiveness in handling cross-modal streaming data retrieval. Despite the promising performance, these methods mainly focus on the supervised learning paradigm, demanding expensive and laborious work to obtain clean annotated data. Existing unsupervised online hashing methods mostly struggle to construct instructive semantic correlations among data chunks, resulting in the forgetting of accumulated data distribution. To this end, we propose a Dynamic Prototype-based Online Cross-modal Hashing method, called DPOCH. Based on the pre-learned reliable common representations, DPOCH generates prototypes incrementally as sketches of accumulated data and updates them dynamically for adapting streaming data. Thereafter, the prototype-based semantic embedding and similarity graphs are designed to promote stability and generalization of the hashing process, thereby obtaining globally adaptive hash codes and hash functions. Experimental results on benchmarked datasets demonstrate that the proposed DPOCH outperforms state-of-the-art unsupervised online cross-modal hashing methods.
Funding
- National Natural Science Foundation of China
- Natural Science Foundation of Shandong Province
- Major Basic Research Project of Natural Science Foundation of Shandong Province
- Taishan Scholar Project of Shandong Province
- Shandong Provincial Natural Science Foundation for Distinguished Young Scholars
Cite
APA
Kang, X., Liu, X., Xue, W., Nie, X., & Yin, Y. (2024). Online Cross-modal Hashing With Dynamic Prototype. ACM Transactions on Multimedia Computing, Communications, and Applications, 20(8), 1-18. https://doi.org/10.1145/3665249
Vancouver
Kang X, Liu X, Xue W, Nie X, Yin Y. Online Cross-modal Hashing With Dynamic Prototype. ACM Transactions on Multimedia Computing, Communications, and Applications. 2024;20(8):1-18. doi:10.1145/3665249
BibTeX
@article{Kang2024,
author = {Kang, Xiao and Liu, Xingbo and Xue, Wen and Nie, Xiushan and Yin, Yilong},
title = {Online Cross-modal Hashing With Dynamic Prototype},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2024},
volume = {20},
number = {8},
pages = {1--18},
doi = {10.1145/3665249}
}
EUVIMED