CLIP-Based Multi-Modal Feature Learning for Cloth-Changing Person Re-Identification
IEEE Transactions on Image Processing · 2025 · 34 · 5570-5583
DOI: 10.1109/tip.2025.3602641 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2025. Verfasst von Guoqing Zhang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 54 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Jiangsu Province of China.
Abstract (Originalsprache)
Contrastive Language-Image Pre-training (CLIP) has achieved remarkable results in the field of person re-identification (ReID) due to its excellent cross-modal understanding ability and high scalability. Since the text encoder of CLIP mainly focuses on easy-to-describe attributes such as clothing, and clothing is the main interference factor that reduces the recognition accuracy in cloth-changing person ReID (CC ReID). Consequently, directly applying CLIP to cloth-changing scenario may be difficult to adapt to such dynamic feature changes, thereby affecting the precision of identification. To solve this challenge, we propose a CLIP-based multi-modal feature learning framework (CMFF) for CC ReID. Specifically, we first design a pose-aware identity enhancement module (PIE) to enhance the model's perception of identity-intrinsic information. In this branch, to weaken the interference of clothing information, we apply a ranking loss to minimize the difference between appearance and pose in the feature space. Secondly, we propose a global-local hybrid attention module (GLHA), which fuses head and global features through a cross-attention mechanism, enhancing the global recognition ability of key head information. Finally, considering that existing CLIP-based methods often ignore the potential importance of shallow features, we propose a graph-based multi-layer interactive enhancement module (GMIE), which groups and integrates multi-layer features of the image encoder, aiming to enhance the contextual awareness of multi-scale features. Extensive experiments on multiple popular pedestrian datasets validate the outstanding performance of our proposed CMFF.
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Jiangsu Province of China
Zitieren
APA
Zhang, G., Zhou, J., Jiang, L., Zheng, Y., & Lin, W. (2025). CLIP-Based Multi-Modal Feature Learning for Cloth-Changing Person Re-Identification. IEEE Transactions on Image Processing, 34, 5570-5583. https://doi.org/10.1109/tip.2025.3602641
Vancouver
Zhang G, Zhou J, Jiang L, Zheng Y, Lin W. CLIP-Based Multi-Modal Feature Learning for Cloth-Changing Person Re-Identification. IEEE Transactions on Image Processing. 2025;34:5570-5583. doi:10.1109/tip.2025.3602641
BibTeX
@article{Zhang2025,
author = {Zhang, Guoqing and Zhou, Jieqiong and Jiang, Lu and Zheng, Yuhui and Lin, Weisi},
title = {CLIP-Based Multi-Modal Feature Learning for Cloth-Changing Person Re-Identification},
journal = {IEEE Transactions on Image Processing},
year = {2025},
volume = {34},
pages = {5570--5583},
doi = {10.1109/tip.2025.3602641}
}
EUVIMED