Relation-Aware Proxy Hashing for Cross-Modal Retrieval
ACM Transactions on Multimedia Computing, Communications, and Applications · 30.06.2026 · 22 (6) · 1-24
DOI: 10.1145/3811910 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 21.05.2026. Verfasst von Jinyu Xu und 5 weiteren Autor:innen. Die Arbeit nennt 66 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, National Key Research and Development Program of China.
Abstract (Originalsprache)
Proxy hashing methods have attracted increasing attention in cross-modal retrieval, because they are able to learn the mapping of different modalities into a common low-dimensional hash space by leveraging global proxies. However, existing approaches typically suffer from two limitations: (1) They solely utilize prior labels to capture the global semantic information, and hence lack the ability to explore necessary fine-grained semantic information to bridge the modality gap effectively. (2) They seldom consider the guidance information of intrinsic semantic similarity on proxy-centered space, and thus fail to leverage the similarity relations among instances sufficiently. To mitigate these limitations, we propose RAPH, a novel Relation-Aware Proxy Hashing framework that learns the semantic relations between different modalities and different semantic levels to enhance the discriminative capability of hash codes. Specifically, we first propose a Local Semantic Interaction (LSI) module based on masked language modeling to achieve the interaction of multi-modal fine-grained semantic features. Second, a relation-aware hashing learning scheme is designed to simultaneously explore the intrinsic semantic relationships and the global semantic information based on proxies. This is achieved by minimizing the reconstruction error between the multi-modal affinity matrices derived from learned features and the cross-modal similarity matrix of the hash codes. The proposed framework is able to learn more discriminative hash codes and achieves superior performance to many baselines on three public datasets.
Förderung
- National Natural Science Foundation of China
- National Key Research and Development Program of China
Zitieren
APA
Xu, J., Xie, Q., Li, J., Ma, Y., Liu, Y., & Bao, Z. (2026). Relation-Aware Proxy Hashing for Cross-Modal Retrieval. ACM Transactions on Multimedia Computing, Communications, and Applications, 22(6), 1-24. https://doi.org/10.1145/3811910
Vancouver
Xu J, Xie Q, Li J, Ma Y, Liu Y, Bao Z. Relation-Aware Proxy Hashing for Cross-Modal Retrieval. ACM Transactions on Multimedia Computing, Communications, and Applications. 2026;22(6):1-24. doi:10.1145/3811910
BibTeX
@article{Xu2026,
author = {Xu, Jinyu and Xie, Qing and Li, Jiachen and Ma, Yanchun and Liu, Yongjian and Bao, Zhifeng},
title = {Relation-Aware Proxy Hashing for Cross-Modal Retrieval},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2026},
volume = {22},
number = {6},
pages = {1--24},
doi = {10.1145/3811910}
}
EUVIMED