Cross-Modal Scene Prior for Adaptive RGB-Guided Infrared Column Stripe Noise Removal
Sensors · 07.06.2026 · 26 (12) · 3638
DOI: 10.3390/s26123638 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 07.06.2026. Verfasst von Bahri Abaci und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Electronics Engineering, Hacettepe University, Ankara 06800, Turkey. Die Arbeit nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Hacettepe University, Hacettepe University Scientific Research Projects (BAP) Coordination Unit.
Abstract (Originalsprache)
Infrared focal plane array detectors produce column stripe noise due to inter-detector response variations. Existing single-frame correction methods operate exclusively on the degraded infrared image and cannot reliably distinguish column noise from genuine vertical scene structures. With the increasing availability of co-registered visible-light cameras in modern electro-optical/infrared payloads, we propose to exploit the visible image as a structural guide for infrared destriping. Through a cross-modal correlation analysis, we show that the structural correspondence between RGB and infrared images is spatially non-uniform, motivating a selective rather than uniform fusion strategy. Based on this observation, we propose CMSP (Cross-Modal Scene Prior), a lightweight single-frame denoising architecture that selectively applies RGB guidance where it is beneficial. The proposed AdaptiveSPADE module blends RGB-guided modulation with standard instance normalization through a learned per-pixel confidence map, while a dual-path output head separately estimates pixel-wise residuals and column-constant stripe patterns. Evaluated on three public RGB–IR datasets, CMSP achieves 51.91 dB PSNR on M3FD, outperforming the best baseline by 5.79 dB with only 638 K parameters. A downstream evaluation on real stripe noise demonstrates that CMSP not only removes artifacts but also preserves the fine structures critical for infrared small target detection. Ablation studies confirm that adaptive gating more than doubles the benefit of RGB guidance compared to uniform modulation, and prevents degradation when cross-modal alignment is weak.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Electrical and Electronics Engineering, Hacettepe University, Ankara 06800, Turkey.
- ASELSAN Inc., Ankara 06830, Turkey.
ORCID-Profile: Bahri Abaci, Seniha Esen Yuksel
Förderung
- Hacettepe University
- Hacettepe University Scientific Research Projects (BAP) Coordination Unit
Zitieren
APA
Abaci, B., & Yuksel, S. E. (2026). Cross-Modal Scene Prior for Adaptive RGB-Guided Infrared Column Stripe Noise Removal. Sensors, 26(12), 3638. https://doi.org/10.3390/s26123638
Vancouver
Abaci B, Yuksel SE. Cross-Modal Scene Prior for Adaptive RGB-Guided Infrared Column Stripe Noise Removal. Sensors. 2026;26(12):3638. doi:10.3390/s26123638
BibTeX
@article{Abaci2026,
author = {Abaci, Bahri and Yuksel, Seniha Esen},
title = {Cross-Modal Scene Prior for Adaptive RGB-Guided Infrared Column Stripe Noise Removal},
journal = {Sensors},
year = {2026},
volume = {26},
number = {12},
pages = {3638},
doi = {10.3390/s26123638}
}
EUVIMED