EUVIMEDEUVIMED entdecken
Crossref

Multi-Stage Auxiliary Learning for Visible-Infrared Person Re-Identification

Huadong Zhang, Shuli Cheng, Anyu Du

IEEE Transactions on Circuits and Systems for Video Technology · 2024-11 · 34 (11) · 12032-12047

DOI: 10.1109/tcsvt.2024.3425536 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-11. Verfasst von Huadong Zhang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 40-mal zitiert (Crossref) und nennt 50 Literaturangaben. Gefördert von: Scientific and Technological Innovation 2030 Major Project, Key Laboratory Open Projects in Xinjiang Uygur Autonomous Region.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Visible-infrared person re-identification (VI-ReID) is a challenging study aimed at retrieving the same person across cameras, time, and modalities. Existing methods usually employ dual-stream networks with integrated constraints, or compensate for modality information to reduce the significant modality discrepancies among heterogeneous images. However, the effectiveness of designed constraints is often limited due to substantial cross-modality differences, and methods that compensate for modality information may introduce noise and additional computational cost. In this paper, we propose a novel Multi-Stage Auxiliary Learning strategy called MSALNet. Specifically, in our approach, the training process is bifurcated into two stages: 1) training with auxiliary modality pairs obtained from grayscale histogram equalization, and 2) training with visible and infrared image pairs to gradually extract more discriminative modality-shared features. We propose the Heterogeneous Feature Compensation Learning (HFCL) module for information compensation and fusion between visible and infrared features, generating auxiliary branches to learn more cross-modality-related information. Additionally, we propose the Modality Similarity Reinforcement (MSR) module to improve the consistency of cross-modality feature representation by suppressing interference information and leveraging pixel similarity probability distribution as supervisory information. Lastly, we design the Distance Center Alignment (DCA) loss to reduce intra-class variations within and between modalities, enhancing the distinguishability among different identities. Experimental results demonstrate MSALNet’s superior performance over most existing methods on two mainstream VI-ReID datasets and effectively saves computational cost.

Förderung

  • Scientific and Technological Innovation 2030 Major Project
  • Key Laboratory Open Projects in Xinjiang Uygur Autonomous Region

Zitieren

APA

Zhang, H., Cheng, S., & Du, A. (2024). Multi-Stage Auxiliary Learning for Visible-Infrared Person Re-Identification. IEEE Transactions on Circuits and Systems for Video Technology, 34(11), 12032-12047. https://doi.org/10.1109/tcsvt.2024.3425536

Vancouver

Zhang H, Cheng S, Du A. Multi-Stage Auxiliary Learning for Visible-Infrared Person Re-Identification. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(11):12032-12047. doi:10.1109/tcsvt.2024.3425536

BibTeX
@article{Zhang2024,
  author = {Zhang, Huadong and Cheng, Shuli and Du, Anyu},
  title = {Multi-Stage Auxiliary Learning for Visible-Infrared Person Re-Identification},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2024},
  volume = {34},
  number = {11},
  pages = {12032--12047},
  doi = {10.1109/tcsvt.2024.3425536}
}
Kostenlos starten →