Learning Progressive Modality-Shared Transformers for Effective Visible-Infrared Person Re-identification
Proceedings of the AAAI Conference on Artificial Intelligence · 26.06.2023 · 37 (2) · 1835-1843
DOI: 10.1609/aaai.v37i2.25273 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 26.06.2023. Verfasst von Hu Lu und 2 weiteren Autor:innen. Die Arbeit wurde bisher 193-mal zitiert (Crossref).
Abstract (Originalsprache)
Visible-Infrared Person Re-Identification (VI-ReID) is a challenging retrieval task under complex modality changes. Existing methods usually focus on extracting discriminative visual features while ignoring the reliability and commonality of visual features between different modalities. In this paper, we propose a novel deep learning framework named Progressive Modality-shared Transformer (PMT) for effective VI-ReID. To reduce the negative effect of modality gaps, we first take the gray-scale images as an auxiliary modality and propose a progressive learning strategy. Then, we propose a Modality-Shared Enhancement Loss (MSEL) to guide the model to explore more reliable identity information from modality-shared features. Finally, to cope with the problem of large intra-class differences and small inter-class differences, we propose a Discriminative Center Loss (DCL) combined with the MSEL to further improve the discrimination of reliable features. Extensive experiments on SYSU-MM01 and RegDB datasets show that our proposed framework performs better than most state-of-the-art methods. For model reproduction, we release the source code at https://github.com/hulu88/PMT.
Zitieren
APA
Lu, H., Zou, X., & Zhang, P. (2023). Learning Progressive Modality-Shared Transformers for Effective Visible-Infrared Person Re-identification. Proceedings of the AAAI Conference on Artificial Intelligence, 37(2), 1835-1843. https://doi.org/10.1609/aaai.v37i2.25273
Vancouver
Lu H, Zou X, Zhang P. Learning Progressive Modality-Shared Transformers for Effective Visible-Infrared Person Re-identification. Proceedings of the AAAI Conference on Artificial Intelligence. 2023;37(2):1835-1843. doi:10.1609/aaai.v37i2.25273
BibTeX
@article{Lu2023,
author = {Lu, Hu and Zou, Xuezhang and Zhang, Pingping},
title = {Learning Progressive Modality-Shared Transformers for Effective Visible-Infrared Person Re-identification},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2023},
volume = {37},
number = {2},
pages = {1835--1843},
doi = {10.1609/aaai.v37i2.25273}
}
EUVIMED