Cross-Modal Object Detection Based on Content-Guided Feature Fusion and Self-Calibration
Sensors · 28.05.2025 · 25 (11) · 3392
DOI: 10.3390/s25113392 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 28.05.2025. Verfasst von Liyang Ning und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Electronic Information and Electrical Engineering, Yangtze University, Jingzhou 434023, China. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Traditional transformers suffer from limitations in local attention, which can result in inadequate feature representation and reduced detection accuracy in cross-modal object detection tasks. Additionally, deep features are prone to degradation through multiple convolutional layers, leading to the loss of detailed information. To address these issues, we propose a dual-backbone cross-modal object detection model based on YOLOv8n. First, we introduce a parallel network in the backbone to enable the model to process information from different modalities simultaneously. Second, we design a content-guided fusion module (CGF) in the feature extraction network, leveraging both transformer and convolution operations to capture global and local information, thereby enhancing the model’s ability to focus on detailed object features. Finally, we propose an adaptive calibration fusion module (ACF) in the neck to fuse shallow and deep features, supplementing fine-grained details and improving the model’s detection capability in complex environments. Experimental results show that on the LLVIP dataset, our model achieves mAP50 of 96.4 and mAP95 of 63.8; on the M3FD dataset, it achieves mAP50 of 83.7 and mAP95 of 56.6. Our model outperforms baseline models and other state-of-the-art methods in detection accuracy, demonstrating robust performance for cross-modal object detection tasks across various environments.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Electronic Information and Electrical Engineering, Yangtze University, Jingzhou 434023, China.
- College of Electronic and Information Engineering, South China University of Technology, Guangzhou 510641, China.
ORCID-Profile: Luoyu Zhou
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Ning, L., Liu, X., Zhou, L., & Zou, X. (2025). Cross-Modal Object Detection Based on Content-Guided Feature Fusion and Self-Calibration. Sensors, 25(11), 3392. https://doi.org/10.3390/s25113392
Vancouver
Ning L, Liu X, Zhou L, Zou X. Cross-Modal Object Detection Based on Content-Guided Feature Fusion and Self-Calibration. Sensors. 2025;25(11):3392. doi:10.3390/s25113392
BibTeX
@article{Ning2025,
author = {Ning, Liyang and Liu, Xuxun and Zhou, Luoyu and Zou, Xueyu},
title = {Cross-Modal Object Detection Based on Content-Guided Feature Fusion and Self-Calibration},
journal = {Sensors},
year = {2025},
volume = {25},
number = {11},
pages = {3392},
doi = {10.3390/s25113392}
}
EUVIMED