EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MCCAR: multi-branch convolutional and confidence-aware registration for infrared-visible images

Shaoliang Fang, Jinsen Sun, Wenhui Chen, Shaojian Qiu, Lu Lu

Frontiers in Computer Science · 18.11.2026 · 8

DOI: 10.3389/fcomp.2026.1933491 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Computer Science, online erschienen am 18.11.2026. Verfasst von Shaoliang Fang und 4 weiteren Autor:innen. Die Arbeit nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Special Project for Research and Development in Key areas of Guangdong Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Infrared-visible image registration is a fundamental preprocessing step for multimodal image fusion, object detection, and complex scene understanding. However, due to the heterogeneous imaging mechanisms of infrared and visible sensors, the two modalities exhibit pronounced non-linear radiometric differences, weakly textured regions, and local occlusions, which make cross-modal geometric correspondence estimation challenging. To address the susceptibility of existing methods to mismatches in unreliable regions and their limited ability to characterize fine-grained geometry in low-texture areas, this paper proposes a confidence-aware infrared-visible image registration network with Multiple Local Detail Convolution, termed MCCAR. Specifically, a CNN-Transformer encoder is first employed to extract modality-shared structural representations and modality-specific detail features. Then, a multiple local detail convolution module is designed to enhance cross-modal geometric cues from multi-scale structures, omnidirectional edges, and Laplacian high-frequency residuals. Furthermore, a pixel-wise confidence estimation branch is introduced to adaptively assess regional matching reliability under occlusion, thermal contrast variation, and texture degradation, with the resulting confidence map serving as a soft mask in the loss function to suppress unreliable correspondences during optimization. Finally, hard negative contrastive learning is adopted to improve the discriminative capability of the network for subtle geometric deviations. Experiments on the RoadScene dataset demonstrate that MCCAR achieves superior registration performance in terms of mutual information, correlation coefficient, and Mean Square Error, while further improving the quality of registration-guided multimodal image fusion.

Förderung

  • Special Project for Research and Development in Key areas of Guangdong Province

Zitieren

APA

Fang, S., Sun, J., Chen, W., Qiu, S., & Lu, L. (2026). MCCAR: multi-branch convolutional and confidence-aware registration for infrared-visible images. Frontiers in Computer Science, 8. https://doi.org/10.3389/fcomp.2026.1933491

Vancouver

Fang S, Sun J, Chen W, Qiu S, Lu L. MCCAR: multi-branch convolutional and confidence-aware registration for infrared-visible images. Frontiers in Computer Science. 2026;8. doi:10.3389/fcomp.2026.1933491

BibTeX
@article{Fang2026,
  author = {Fang, Shaoliang and Sun, Jinsen and Chen, Wenhui and Qiu, Shaojian and Lu, Lu},
  title = {MCCAR: multi-branch convolutional and confidence-aware registration for infrared-visible images},
  journal = {Frontiers in Computer Science},
  year = {2026},
  volume = {8},
  doi = {10.3389/fcomp.2026.1933491}
}
Kostenlos starten →