TCCDNet: A Multimodal Pedestrian Detection Network Integrating Cross-Modal Complementarity with Deep Feature Fusion
Sensors · 25.04.2025 · 25 (9) · 2727
DOI: 10.3390/s25092727 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 25.04.2025. Verfasst von Shipeng Han und 6 weiteren Autor:innen. Beteiligte Einrichtung: School of Biomedical Engineering, Air Force Medical University, Xi'an 710032, China. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Air Force Medical University Talent Program, Talent Project of University.
Abstract (Originalsprache)
Multimodal pedestrian detection has garnered significant attention due to its potential applications in complex scenarios. The complementarity characteristics between infrared and visible modalities can enhance detection performance. However, the design of cross-modal fusion mechanisms and the in-depth exploration of inter-modal complementarity still pose challenges. To address this, we propose TCCDNet, a novel network integrating cross-modal complementarity. Specifically, the efficient multi-scale attention C2f (EMAC) is designed for the backbone, which combines the C2f structure with an efficient multi-scale attention mechanism to achieve feature weighting and fusion, thereby enhancing the model’s feature extraction capacity. Subsequently, the cross-modal complementarity (CMC) module is proposed, which enhances feature discriminability and object localization accuracy through a synergistic mechanism combining channel attention and spatial attention. Additionally, a deep semantic fusion module (DSFM) based on a cross-attention mechanism is incorporated to achieve deep semantic feature fusion. The experimental results demonstrate that TCCDNet achieves a MR−2 of 7.87% on the KAIST dataset, representing a 3.83% reduction compared to YOLOv8. For the other two multimodal pedestrian detection datasets, TCCDNet attains mAP50 scores of 83.8% for FLIR ADAS and 97.3% for LLVIP, outperforming the baseline by 3.6% and 1.9% respectively. These results fully validate the effectiveness and advancement of the proposed method.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Biomedical Engineering, Air Force Medical University, Xi'an 710032, China.
- School of Information and Control Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, China.
Förderung
- Air Force Medical University Talent Program
- Talent Project of University
Zitieren
APA
Han, S., Chai, C., Hu, M., Wang, Y., Jiao, T., Wang, J., & Lv, H. (2025). TCCDNet: A Multimodal Pedestrian Detection Network Integrating Cross-Modal Complementarity with Deep Feature Fusion. Sensors, 25(9), 2727. https://doi.org/10.3390/s25092727
Vancouver
Han S, Chai C, Hu M, Wang Y, Jiao T, Wang J, et al. TCCDNet: A Multimodal Pedestrian Detection Network Integrating Cross-Modal Complementarity with Deep Feature Fusion. Sensors. 2025;25(9):2727. doi:10.3390/s25092727
BibTeX
@article{Han2025,
author = {Han, Shipeng and Chai, Chaowen and Hu, Min and Wang, Yanni and Jiao, Teng and Wang, Jianqi and Lv, Hao},
title = {TCCDNet: A Multimodal Pedestrian Detection Network Integrating Cross-Modal Complementarity with Deep Feature Fusion},
journal = {Sensors},
year = {2025},
volume = {25},
number = {9},
pages = {2727},
doi = {10.3390/s25092727}
}
EUVIMED