EUVIMEDEUVIMED entdecken
Crossref

Fast Unsupervised Cross-Modal Hashing with Robust Factorization and Dual Projection

Xingbo Liu, Jiamin Li, Xiushan Nie, Xuening Zhang, Yilong Yin

ACM Transactions on Multimedia Computing, Communications, and Applications · 31.12.2024 · 20 (12) · 1-21

DOI: 10.1145/3694684 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 26.11.2024. Verfasst von Xingbo Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 59 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Shandong Provincial Natural Science Foundation, Major Basic Research Project of Natural Science Foundation of Shandong Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Unsupervised hashing has attracted extensive attention in effectively and efficiently tackling large-scale cross-modal retrieval task. Existing methods typically try to mine the latent common subspace across multimodal data without any category annotation. Despite the exciting progress, there are still three challenges that need to be further addressed: (1) efficiently improving the robustness during latent common subspace learning; (2) harmoniously embedding the intra-modal inherence and inter-modal relevance of multimodal data into Hamming space; and (3) effectively reducing the training time complexity and making the model scalable for large-scale datasets. To well address the above challenges, this study proposes a method named Fast Unsupervised Cross-Modal Hashing (FUCH). Specifically, FUCH proposes a semantic-aware collective matrix factorization to learn robust representation via exploiting latent category-specific attributes, and introduces Cauchy loss to measure the factorization process. Accordingly, the above process can effectively embed potential discriminative information into common space, while making the model insensitive for outliers. Moreover, FUCH designs a dual projection learning scheme, which not only learns modality-unique hash functions to excavate individual properties but also learns modality-mutual hash functions to multimodal correlational properties. Experimental results on three benchmark datasets verify the effectiveness of FUCH under various scenarios.

Förderung

  • National Natural Science Foundation of China
  • Shandong Provincial Natural Science Foundation
  • Major Basic Research Project of Natural Science Foundation of Shandong Province
  • Taishan Scholar Project of Shandong Province
  • Shandong Provincial Natural Science Foundation for Distinguished Young Scholars
  • Major Science and Technology Innovation Project of Shandong Province

Zitieren

APA

Liu, X., Li, J., Nie, X., Zhang, X., & Yin, Y. (2024). Fast Unsupervised Cross-Modal Hashing with Robust Factorization and Dual Projection. ACM Transactions on Multimedia Computing, Communications, and Applications, 20(12), 1-21. https://doi.org/10.1145/3694684

Vancouver

Liu X, Li J, Nie X, Zhang X, Yin Y. Fast Unsupervised Cross-Modal Hashing with Robust Factorization and Dual Projection. ACM Transactions on Multimedia Computing, Communications, and Applications. 2024;20(12):1-21. doi:10.1145/3694684

BibTeX
@article{Liu2024,
  author = {Liu, Xingbo and Li, Jiamin and Nie, Xiushan and Zhang, Xuening and Yin, Yilong},
  title = {Fast Unsupervised Cross-Modal Hashing with Robust Factorization and Dual Projection},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2024},
  volume = {20},
  number = {12},
  pages = {1--21},
  doi = {10.1145/3694684}
}
Kostenlos starten →