EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MCF-YOLO: Consistency-Guided Cross-Modal Attention for Small-Object RGB-IR Detection

Xiang Yang, Mengyue Yang, Xiaolan Xie

Sensors · 21.06.2026 · 26 (12) · 3938

DOI: 10.3390/s26123938 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 21.06.2026. Verfasst von Xiang Yang und 2 weiteren Autor:innen. Beteiligte Einrichtung: College of Computer Science and Engineering, Guilin University of Technology, Guilin 541006, China. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: the Guangxi Science and Technology, the National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In low-light, occluded, and cluttered environments, single-modality RGB detectors are prone to false positives and missed detections. While infrared (IR) imaging provides relatively stable target visibility under poor illumination, it lacks texture and color information and is susceptible to background thermal noise and imaging variations. To address these limitations, this paper proposes an RGB–IR object detection network, named MCF-YOLO, consisting of three core components. First, the Cross-Modal Hierarchical Fusion (CMHF) module performs stage-wise alignment and fusion on multi-scale features, jointly modeling RGB texture details and IR thermal responses to exploit the structural and semantic complementarity between the two modalities. Second, the Soft Attention Regularization based on Attention Prior (SAR-AP) module derives attention priors from IR features to impose soft constraints on cross-modal attention maps. This mechanism helps the network maintain attention on target-relevant regions, thereby suppressing attention drift caused by low-light noise and complex backgrounds. Third, the Small-Object-Sensitive Detection Head (SOS-Head) processes high-resolution features to strengthen the representation of small targets, improving detection capability in long-range and occluded scenarios. In evaluations on two RGB–IR benchmarks—M3FD and VEDAI—MCF-YOLO achieves improvements of 2.7% in mAP@0.5 and 1.1% in mAP@0.5:0.95 on M3FD, and 5.4% and 4.4%, respectively, on VEDAI. These results suggest that consistency-guided cross-modal fusion and high-resolution small-target modeling are beneficial for RGB–IR detection in low-visibility and cluttered scenes.

Schlagwörter

Stichwörter der Autor:innen

RGB–IR fusion object detectioncross-modal attention mechanismmodality consistency constraintmulti-level feature fusionsmall object detection

Autor:innen und Institutionen

  • College of Computer Science and Engineering, Guilin University of Technology, Guilin 541006, China.
  • Guangxi Key Laboratory of Embedded Technology and Intelligent System, Guilin University of Technology, Guilin 541004, China.

Förderung

  • the Guangxi Science and Technology
  • the National Natural Science Foundation of China

Zitieren

APA

Yang, X., Yang, M., & Xie, X. (2026). MCF-YOLO: Consistency-Guided Cross-Modal Attention for Small-Object RGB-IR Detection. Sensors, 26(12), 3938. https://doi.org/10.3390/s26123938

Vancouver

Yang X, Yang M, Xie X. MCF-YOLO: Consistency-Guided Cross-Modal Attention for Small-Object RGB-IR Detection. Sensors. 2026;26(12):3938. doi:10.3390/s26123938

BibTeX
@article{Yang2026,
  author = {Yang, Xiang and Yang, Mengyue and Xie, Xiaolan},
  title = {MCF-YOLO: Consistency-Guided Cross-Modal Attention for Small-Object RGB-IR Detection},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {12},
  pages = {3938},
  doi = {10.3390/s26123938}
}
Kostenlos starten →