EUVIMEDScopri EUVIMED
Crossref

Online Cross-modal Hashing With Dynamic Prototype

Xiao Kang, Xingbo Liu, Wen Xue, Xiushan Nie, Yilong Yin

ACM Transactions on Multimedia Computing, Communications, and Applications · 2024-08-31 · 20 (8) · 1-18

DOI: 10.1145/3665249 ↗

At a glance

Journal article in ACM Transactions on Multimedia Computing, Communications, and Applications, published online on 2024-06-13. Written by Xiao Kang and 4 co-authors. Cited 11 times so far (Crossref); 54 references. Funded by: National Natural Science Foundation of China, Natural Science Foundation of Shandong Province, Major Basic Research Project of Natural Science Foundation of Shandong Province.

AbstractDati bibliograficiCiteRelated studies

Abstract (original language)

Online cross-modal hashing has received increasing attention due to its efficiency and effectiveness in handling cross-modal streaming data retrieval. Despite the promising performance, these methods mainly focus on the supervised learning paradigm, demanding expensive and laborious work to obtain clean annotated data. Existing unsupervised online hashing methods mostly struggle to construct instructive semantic correlations among data chunks, resulting in the forgetting of accumulated data distribution. To this end, we propose a Dynamic Prototype-based Online Cross-modal Hashing method, called DPOCH. Based on the pre-learned reliable common representations, DPOCH generates prototypes incrementally as sketches of accumulated data and updates them dynamically for adapting streaming data. Thereafter, the prototype-based semantic embedding and similarity graphs are designed to promote stability and generalization of the hashing process, thereby obtaining globally adaptive hash codes and hash functions. Experimental results on benchmarked datasets demonstrate that the proposed DPOCH outperforms state-of-the-art unsupervised online cross-modal hashing methods.

Funding

  • National Natural Science Foundation of China
  • Natural Science Foundation of Shandong Province
  • Major Basic Research Project of Natural Science Foundation of Shandong Province
  • Taishan Scholar Project of Shandong Province
  • Shandong Provincial Natural Science Foundation for Distinguished Young Scholars

Cite

APA

Kang, X., Liu, X., Xue, W., Nie, X., & Yin, Y. (2024). Online Cross-modal Hashing With Dynamic Prototype. ACM Transactions on Multimedia Computing, Communications, and Applications, 20(8), 1-18. https://doi.org/10.1145/3665249

Vancouver

Kang X, Liu X, Xue W, Nie X, Yin Y. Online Cross-modal Hashing With Dynamic Prototype. ACM Transactions on Multimedia Computing, Communications, and Applications. 2024;20(8):1-18. doi:10.1145/3665249

BibTeX
@article{Kang2024,
  author = {Kang, Xiao and Liu, Xingbo and Xue, Wen and Nie, Xiushan and Yin, Yilong},
  title = {Online Cross-modal Hashing With Dynamic Prototype},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2024},
  volume = {20},
  number = {8},
  pages = {1--18},
  doi = {10.1145/3665249}
}
Start for free →