EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Joint Semantic Preserving Sparse Hashing for Cross-Modal Retrieval

Zhikai Hu, Yiu-Ming Cheung, Mengke Li, Weichao Lan, Donglin Zhang, Qiang Liu

IEEE Transactions on Circuits and Systems for Video Technology · 2024-04 · 34 (4) · 2989-3002

DOI: 10.1109/tcsvt.2023.3307608 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-04. Verfasst von Zhikai Hu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 75 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NSFC/Research Grants Council (RGC) Joint Research Scheme, General Research Fund of RGC, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Supervised cross-modal hashing has received wide attention in recent years. However, existing methods primarily rely on sample-wise semantic relationships to evaluate the semantic similarity between samples, overlooking the impact of label distribution on enhancing retrieval performance. Moreover, the limited representation capability of traditional dense hash codes hinders the preservation of semantic relationship. To overcome these challenges, we propose a new method, Joint Semantic Preserving Sparse Hashing (JSPSH). Specifically, we introduce a new concept of cluster-wise semantic relationship, which leverages label distribution to indicate which samples are more suitable for clustering. Then, we jointly utilize sample-wise and cluster-wise semantic relationships to supervise the learning of hash codes. In this way, JSPSH preserves both kinds of semantic relationships to ensure that more samples with similar semantics are clustered together, thereby achieving better retrieval results. Furthermore, we utilize high-dimensional sparse hash codes that offer stronger representation capability to preserve such more complex semantics. Finally, an interaction term is introduced in hash functions learning stage to further narrow the gap between modalities. Experimental results on three large-scale datasets demonstrate the effectiveness of JSPSH in achieving superior retrieval performance.

Förderung

  • NSFC/Research Grants Council (RGC) Joint Research Scheme
  • General Research Fund of RGC
  • National Natural Science Foundation of China
  • NSFC
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

Hu, Z., Cheung, Y., Li, M., Lan, W., Zhang, D., & Liu, Q. (2024). Joint Semantic Preserving Sparse Hashing for Cross-Modal Retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 34(4), 2989-3002. https://doi.org/10.1109/tcsvt.2023.3307608

Vancouver

Hu Z, Cheung Y, Li M, Lan W, Zhang D, Liu Q. Joint Semantic Preserving Sparse Hashing for Cross-Modal Retrieval. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(4):2989-3002. doi:10.1109/tcsvt.2023.3307608

BibTeX
@article{Hu2024,
  author = {Hu, Zhikai and Cheung, Yiu-Ming and Li, Mengke and Lan, Weichao and Zhang, Donglin and Liu, Qiang},
  title = {Joint Semantic Preserving Sparse Hashing for Cross-Modal Retrieval},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2024},
  volume = {34},
  number = {4},
  pages = {2989--3002},
  doi = {10.1109/tcsvt.2023.3307608}
}
Kostenlos starten →