EUVIMEDEUVIMED entdecken
Crossref

Multi-Modal Object Re-Identification With Dual Semantic Guidance and Global--Local Mutual Modulation

Weixiang Zhou, Xingguo Xu, Yuhao Wang, Cong Wang, Yang Yang, Zhixun Su, Jinshan Pan

IEEE Transactions on Circuits and Systems for Video Technology · 2026-11 · 36 (11) · 17732-17747

DOI: 10.1109/tcsvt.2026.3718646 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2026-11. Verfasst von Weixiang Zhou und 6 weiteren Autor:innen. Die Arbeit nennt 73 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multi-modal object Re-Identification (ReID) aims to retrieve target instances by leveraging complementary information across modalities. However, existing methods suffer from two challenges. First, they often fail to exploit well-aligned and reliable semantic priors, making them vulnerable to background clutter and cross-modal misalignment. On the other hand, they typically rely on holistic feature modeling, overlooking the synergy between global and local representations. To overcome these limitations, we propose a robust multi-modal ReID framework with dual semantic guidance and global-local mutual modulation, which mainly consists of three key components, namely the Text-Semantic Injector (TSI), the Masked Global-Local Modulator (MGLM), and the Hierarchical MoE Fusion (HMF). The TSI enhances semantic awareness by integrating clean and coherent textual features into visual tokens. The MGLM enables part-aware cross-modal interaction through joint guidance from soft masks and global context, improving fine-grained feature alignment. Finally, the HMF adaptively aggregates multi-spectral features under local semantic supervision, yielding discriminative and robust representations. Extensive experiments on three multi-modal ReID benchmarks demonstrate the effectiveness of the proposed method. The code will be made publicly available at https://github.com/zw-absin/DSGM upon acceptance.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Zhou, W., Xu, X., Wang, Y., Wang, C., Yang, Y., Su, Z., & Pan, J. (2026). Multi-Modal Object Re-Identification With Dual Semantic Guidance and Global--Local Mutual Modulation. IEEE Transactions on Circuits and Systems for Video Technology, 36(11), 17732-17747. https://doi.org/10.1109/tcsvt.2026.3718646

Vancouver

Zhou W, Xu X, Wang Y, Wang C, Yang Y, Su Z, et al. Multi-Modal Object Re-Identification With Dual Semantic Guidance and Global--Local Mutual Modulation. IEEE Transactions on Circuits and Systems for Video Technology. 2026;36(11):17732-17747. doi:10.1109/tcsvt.2026.3718646

BibTeX
@article{Zhou2026,
  author = {Zhou, Weixiang and Xu, Xingguo and Wang, Yuhao and Wang, Cong and Yang, Yang and Su, Zhixun and Pan, Jinshan},
  title = {Multi-Modal Object Re-Identification With Dual Semantic Guidance and Global--Local Mutual Modulation},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2026},
  volume = {36},
  number = {11},
  pages = {17732--17747},
  doi = {10.1109/tcsvt.2026.3718646}
}
Kostenlos starten →