Semantic Disentanglement Adversarial Hashing for Cross-Modal Retrieval
IEEE Transactions on Circuits and Systems for Video Technology · 2024-03 · 34 (3) · 1914-1926
DOI: 10.1109/tcsvt.2023.3293104 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-03. Verfasst von Min Meng und 4 weiteren Autor:innen. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 53 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Guangdong Province, Basic and Applied Basic Research Foundation of Guangdong Province.
Abstract (Originalsprache)
Cross-modal hashing has gained considerable attention in cross-modal retrieval due to its low storage cost and prominent computational efficiency. However, preserving more semantic information in the compact hash codes to bridge the modality gap still remains challenging. Most existing methods unconsciously neglect the influence of modality-private information on semantic embedding discrimination, leading to unsatisfactory retrieval performance. In this paper, we propose a novel deep cross-modal hashing method, called Semantic Disentanglement Adversarial Hashing (SDAH), to tackle these challenges for cross-modal retrieval. Specifically, SDAH is designed to decouple the original features of each modality into modality-common features with semantic information and modality-private features with disturbing information. After the preliminary decoupling, the modality-private features are shuffled and treated as positive interactions to enhance the learning of modality-common features, which can significantly boost the discriminative and robustness of semantic embeddings. Moreover, the variational information bottleneck is introduced in the hash feature learning process, which can avoid the loss of a large amount of semantic information caused by the high-dimensional feature compression. Finally, the discriminative and compact hash codes can be computed directly from the hash features. A large number of comparative and ablation experiments show that SDAH achieves superior performance than other state-ofthe- art methods.
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Guangdong Province
- Basic and Applied Basic Research Foundation of Guangdong Province
- Huangpu International Sci&Tech Cooperation Foundation of Guangzhou
Zitieren
APA
Meng, M., Sun, J., Liu, J., Yu, J., & Wu, J. (2024). Semantic Disentanglement Adversarial Hashing for Cross-Modal Retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 34(3), 1914-1926. https://doi.org/10.1109/tcsvt.2023.3293104
Vancouver
Meng M, Sun J, Liu J, Yu J, Wu J. Semantic Disentanglement Adversarial Hashing for Cross-Modal Retrieval. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(3):1914-1926. doi:10.1109/tcsvt.2023.3293104
BibTeX
@article{Meng2024,
author = {Meng, Min and Sun, Jiaxuan and Liu, Jigang and Yu, Jun and Wu, Jigang},
title = {Semantic Disentanglement Adversarial Hashing for Cross-Modal Retrieval},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2024},
volume = {34},
number = {3},
pages = {1914--1926},
doi = {10.1109/tcsvt.2023.3293104}
}
EUVIMED