Multi-Modal Object Re-Identification With Dual Semantic Guidance and Global--Local Mutual Modulation
IEEE Transactions on Circuits and Systems for Video Technology · 2026-11 · 36 (11) · 17732-17747
DOI: 10.1109/tcsvt.2026.3718646 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2026-11. Verfasst von Weixiang Zhou und 6 weiteren Autor:innen. Die Arbeit nennt 73 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Multi-modal object Re-Identification (ReID) aims to retrieve target instances by leveraging complementary information across modalities. However, existing methods suffer from two challenges. First, they often fail to exploit well-aligned and reliable semantic priors, making them vulnerable to background clutter and cross-modal misalignment. On the other hand, they typically rely on holistic feature modeling, overlooking the synergy between global and local representations. To overcome these limitations, we propose a robust multi-modal ReID framework with dual semantic guidance and global-local mutual modulation, which mainly consists of three key components, namely the Text-Semantic Injector (TSI), the Masked Global-Local Modulator (MGLM), and the Hierarchical MoE Fusion (HMF). The TSI enhances semantic awareness by integrating clean and coherent textual features into visual tokens. The MGLM enables part-aware cross-modal interaction through joint guidance from soft masks and global context, improving fine-grained feature alignment. Finally, the HMF adaptively aggregates multi-spectral features under local semantic supervision, yielding discriminative and robust representations. Extensive experiments on three multi-modal ReID benchmarks demonstrate the effectiveness of the proposed method. The code will be made publicly available at https://github.com/zw-absin/DSGM upon acceptance.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Zhou, W., Xu, X., Wang, Y., Wang, C., Yang, Y., Su, Z., & Pan, J. (2026). Multi-Modal Object Re-Identification With Dual Semantic Guidance and Global--Local Mutual Modulation. IEEE Transactions on Circuits and Systems for Video Technology, 36(11), 17732-17747. https://doi.org/10.1109/tcsvt.2026.3718646
Vancouver
Zhou W, Xu X, Wang Y, Wang C, Yang Y, Su Z, et al. Multi-Modal Object Re-Identification With Dual Semantic Guidance and Global--Local Mutual Modulation. IEEE Transactions on Circuits and Systems for Video Technology. 2026;36(11):17732-17747. doi:10.1109/tcsvt.2026.3718646
BibTeX
@article{Zhou2026,
author = {Zhou, Weixiang and Xu, Xingguo and Wang, Yuhao and Wang, Cong and Yang, Yang and Su, Zhixun and Pan, Jinshan},
title = {Multi-Modal Object Re-Identification With Dual Semantic Guidance and Global--Local Mutual Modulation},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2026},
volume = {36},
number = {11},
pages = {17732--17747},
doi = {10.1109/tcsvt.2026.3718646}
}
EUVIMED