EUVIMEDEUVIMED entdecken
Crossref

A Semantic Perception and CNN-Transformer Hybrid Network for Occluded Person Re-Identification

Zan Gao, Peng Chen, Tao Zhuo, Meng Liu, Lei Zhu, Meng Wang, Shengyong Chen

IEEE Transactions on Circuits and Systems for Video Technology · 2024-04 · 34 (4) · 2010-2025

DOI: 10.1109/tcsvt.2023.3296680 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-04. Verfasst von Zan Gao und 6 weiteren Autor:innen. Die Arbeit wurde bisher 42-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Young Creative Team in Universities of Shandong Province, Jinan 20 Projects in Universities.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The objective of the occluded person re-identification (ReID) task is to capture the same person from different camera angles when the pedestrian’s body is partially occluded. In this task, there are two main challenges: 1) pedestrians are often occluded by other persons or objects, and 2) pedestrians change poses. Moreover, these two issues often simultaneously occur. Although many occluded person ReID algorithms have been proposed, many existing methods can often only solve one of these issues well, and the other issue is often ignored. In this work, a novel semantic perception and CNN-transformer hybrid network (abbreviated as SPH) is proposed for occluded person ReID, which consists of a CNN-based human semantic perception stream and a transformer-based pose perception stream. In the former, a human semantic auxiliary module and a human semantic perception module are designed to obtain human semantic information where multi-granularity region features of the human body are extracted to solve the issues of occlusion. In the latter, we propose a token-based pose integration module to obtain the corresponding patch for each pose key-point and the relative position information to solve the change in pedestrian pose. Moreover, these two streams are jointly optimized in a unified framework. In addition, to further solve the issue of occlusion, the human completion strategy is proposed for the query sample where the gallery samples are used to complete the missing parts of the query. Extensive experimental results on three public occluded person ReID datasets, Occluded-DukeMTMC, P-DukeMTMC-reID, and Occluded-REID, demonstrate that the proposed method can outperform all SOTA occluded person ReID methods in terms of the mAP and Rank-1. Compared with PAT (CVPR21) on the Occluded-DukeMTMC and Occluded-REID datasets, the improvements in mAP/Rank-1 reached 10.1%/7.4%, and 10%/1%, respectively. Moreover, when TransReID (ICCV21) was used, SPH achieved improvements of 4.5% (mAP) and 5.5% (Rank-1) on the Occluded-DukeMTMC dataset.

Förderung

  • National Natural Science Foundation of China
  • Young Creative Team in Universities of Shandong Province
  • Jinan 20 Projects in Universities
  • Shandong Project Towards the Integration of Education and Industry

Zitieren

APA

Gao, Z., Chen, P., Zhuo, T., Liu, M., Zhu, L., Wang, M., & Chen, S. (2024). A Semantic Perception and CNN-Transformer Hybrid Network for Occluded Person Re-Identification. IEEE Transactions on Circuits and Systems for Video Technology, 34(4), 2010-2025. https://doi.org/10.1109/tcsvt.2023.3296680

Vancouver

Gao Z, Chen P, Zhuo T, Liu M, Zhu L, Wang M, et al. A Semantic Perception and CNN-Transformer Hybrid Network for Occluded Person Re-Identification. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(4):2010-2025. doi:10.1109/tcsvt.2023.3296680

BibTeX
@article{Gao2024,
  author = {Gao, Zan and Chen, Peng and Zhuo, Tao and Liu, Meng and Zhu, Lei and Wang, Meng and Chen, Shengyong},
  title = {A Semantic Perception and CNN-Transformer Hybrid Network for Occluded Person Re-Identification},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2024},
  volume = {34},
  number = {4},
  pages = {2010--2025},
  doi = {10.1109/tcsvt.2023.3296680}
}
Kostenlos starten →