EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

TCCDNet: A Multimodal Pedestrian Detection Network Integrating Cross-Modal Complementarity with Deep Feature Fusion

Shipeng Han, Chaowen Chai, Min Hu, Yanni Wang, Teng Jiao, Jianqi Wang, Hao Lv

Sensors · 25.04.2025 · 25 (9) · 2727

DOI: 10.3390/s25092727 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 25.04.2025. Verfasst von Shipeng Han und 6 weiteren Autor:innen. Beteiligte Einrichtung: School of Biomedical Engineering, Air Force Medical University, Xi'an 710032, China. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Air Force Medical University Talent Program, Talent Project of University.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal pedestrian detection has garnered significant attention due to its potential applications in complex scenarios. The complementarity characteristics between infrared and visible modalities can enhance detection performance. However, the design of cross-modal fusion mechanisms and the in-depth exploration of inter-modal complementarity still pose challenges. To address this, we propose TCCDNet, a novel network integrating cross-modal complementarity. Specifically, the efficient multi-scale attention C2f (EMAC) is designed for the backbone, which combines the C2f structure with an efficient multi-scale attention mechanism to achieve feature weighting and fusion, thereby enhancing the model’s feature extraction capacity. Subsequently, the cross-modal complementarity (CMC) module is proposed, which enhances feature discriminability and object localization accuracy through a synergistic mechanism combining channel attention and spatial attention. Additionally, a deep semantic fusion module (DSFM) based on a cross-attention mechanism is incorporated to achieve deep semantic feature fusion. The experimental results demonstrate that TCCDNet achieves a MR−2 of 7.87% on the KAIST dataset, representing a 3.83% reduction compared to YOLOv8. For the other two multimodal pedestrian detection datasets, TCCDNet attains mAP50 scores of 83.8% for FLIR ADAS and 97.3% for LLVIP, outperforming the baseline by 3.6% and 1.9% respectively. These results fully validate the effectiveness and advancement of the proposed method.

Schlagwörter

Stichwörter der Autor:innen

cross-modal information complementarityfeature fusionmultimodal fusionpedestrian detection

Autor:innen und Institutionen

  • School of Biomedical Engineering, Air Force Medical University, Xi'an 710032, China.
  • School of Information and Control Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, China.

Förderung

  • Air Force Medical University Talent Program
  • Talent Project of University

Zitieren

APA

Han, S., Chai, C., Hu, M., Wang, Y., Jiao, T., Wang, J., & Lv, H. (2025). TCCDNet: A Multimodal Pedestrian Detection Network Integrating Cross-Modal Complementarity with Deep Feature Fusion. Sensors, 25(9), 2727. https://doi.org/10.3390/s25092727

Vancouver

Han S, Chai C, Hu M, Wang Y, Jiao T, Wang J, et al. TCCDNet: A Multimodal Pedestrian Detection Network Integrating Cross-Modal Complementarity with Deep Feature Fusion. Sensors. 2025;25(9):2727. doi:10.3390/s25092727

BibTeX
@article{Han2025,
  author = {Han, Shipeng and Chai, Chaowen and Hu, Min and Wang, Yanni and Jiao, Teng and Wang, Jianqi and Lv, Hao},
  title = {TCCDNet: A Multimodal Pedestrian Detection Network Integrating Cross-Modal Complementarity with Deep Feature Fusion},
  journal = {Sensors},
  year = {2025},
  volume = {25},
  number = {9},
  pages = {2727},
  doi = {10.3390/s25092727}
}
Kostenlos starten →