EUVIMEDEUVIMED entdecken
Crossref

Semantic Disentanglement Adversarial Hashing for Cross-Modal Retrieval

Min Meng, Jiaxuan Sun, Jigang Liu, Jun Yu, Jigang Wu

IEEE Transactions on Circuits and Systems for Video Technology · 2024-03 · 34 (3) · 1914-1926

DOI: 10.1109/tcsvt.2023.3293104 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-03. Verfasst von Min Meng und 4 weiteren Autor:innen. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 53 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Guangdong Province, Basic and Applied Basic Research Foundation of Guangdong Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Cross-modal hashing has gained considerable attention in cross-modal retrieval due to its low storage cost and prominent computational efficiency. However, preserving more semantic information in the compact hash codes to bridge the modality gap still remains challenging. Most existing methods unconsciously neglect the influence of modality-private information on semantic embedding discrimination, leading to unsatisfactory retrieval performance. In this paper, we propose a novel deep cross-modal hashing method, called Semantic Disentanglement Adversarial Hashing (SDAH), to tackle these challenges for cross-modal retrieval. Specifically, SDAH is designed to decouple the original features of each modality into modality-common features with semantic information and modality-private features with disturbing information. After the preliminary decoupling, the modality-private features are shuffled and treated as positive interactions to enhance the learning of modality-common features, which can significantly boost the discriminative and robustness of semantic embeddings. Moreover, the variational information bottleneck is introduced in the hash feature learning process, which can avoid the loss of a large amount of semantic information caused by the high-dimensional feature compression. Finally, the discriminative and compact hash codes can be computed directly from the hash features. A large number of comparative and ablation experiments show that SDAH achieves superior performance than other state-ofthe- art methods.

Förderung

  • National Natural Science Foundation of China
  • Natural Science Foundation of Guangdong Province
  • Basic and Applied Basic Research Foundation of Guangdong Province
  • Huangpu International Sci&Tech Cooperation Foundation of Guangzhou

Zitieren

APA

Meng, M., Sun, J., Liu, J., Yu, J., & Wu, J. (2024). Semantic Disentanglement Adversarial Hashing for Cross-Modal Retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 34(3), 1914-1926. https://doi.org/10.1109/tcsvt.2023.3293104

Vancouver

Meng M, Sun J, Liu J, Yu J, Wu J. Semantic Disentanglement Adversarial Hashing for Cross-Modal Retrieval. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(3):1914-1926. doi:10.1109/tcsvt.2023.3293104

BibTeX
@article{Meng2024,
  author = {Meng, Min and Sun, Jiaxuan and Liu, Jigang and Yu, Jun and Wu, Jigang},
  title = {Semantic Disentanglement Adversarial Hashing for Cross-Modal Retrieval},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2024},
  volume = {34},
  number = {3},
  pages = {1914--1926},
  doi = {10.1109/tcsvt.2023.3293104}
}
Kostenlos starten →