EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Cross-Modal Object Detection Based on Content-Guided Feature Fusion and Self-Calibration

Liyang Ning, Xuxun Liu, Luoyu Zhou iD, Xueyu Zou

Sensors · 28.05.2025 · 25 (11) · 3392

DOI: 10.3390/s25113392 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 28.05.2025. Verfasst von Liyang Ning und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Electronic Information and Electrical Engineering, Yangtze University, Jingzhou 434023, China. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Traditional transformers suffer from limitations in local attention, which can result in inadequate feature representation and reduced detection accuracy in cross-modal object detection tasks. Additionally, deep features are prone to degradation through multiple convolutional layers, leading to the loss of detailed information. To address these issues, we propose a dual-backbone cross-modal object detection model based on YOLOv8n. First, we introduce a parallel network in the backbone to enable the model to process information from different modalities simultaneously. Second, we design a content-guided fusion module (CGF) in the feature extraction network, leveraging both transformer and convolution operations to capture global and local information, thereby enhancing the model’s ability to focus on detailed object features. Finally, we propose an adaptive calibration fusion module (ACF) in the neck to fuse shallow and deep features, supplementing fine-grained details and improving the model’s detection capability in complex environments. Experimental results show that on the LLVIP dataset, our model achieves mAP50 of 96.4 and mAP95 of 63.8; on the M3FD dataset, it achieves mAP50 of 83.7 and mAP95 of 56.6. Our model outperforms baseline models and other state-of-the-art methods in detection accuracy, demonstrating robust performance for cross-modal object detection tasks across various environments.

Schlagwörter

Stichwörter der Autor:innen

YOLOv8cross-modalobject detectionself-calibrationtransformer

Autor:innen und Institutionen

  • School of Electronic Information and Electrical Engineering, Yangtze University, Jingzhou 434023, China.
  • College of Electronic and Information Engineering, South China University of Technology, Guangzhou 510641, China.

ORCID-Profile: Luoyu Zhou

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Ning, L., Liu, X., Zhou, L., & Zou, X. (2025). Cross-Modal Object Detection Based on Content-Guided Feature Fusion and Self-Calibration. Sensors, 25(11), 3392. https://doi.org/10.3390/s25113392

Vancouver

Ning L, Liu X, Zhou L, Zou X. Cross-Modal Object Detection Based on Content-Guided Feature Fusion and Self-Calibration. Sensors. 2025;25(11):3392. doi:10.3390/s25113392

BibTeX
@article{Ning2025,
  author = {Ning, Liyang and Liu, Xuxun and Zhou, Luoyu and Zou, Xueyu},
  title = {Cross-Modal Object Detection Based on Content-Guided Feature Fusion and Self-Calibration},
  journal = {Sensors},
  year = {2025},
  volume = {25},
  number = {11},
  pages = {3392},
  doi = {10.3390/s25113392}
}
Kostenlos starten →