EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Cross-Modal Scene Prior for Adaptive RGB-Guided Infrared Column Stripe Noise Removal

Bahri Abaci iD, Seniha Esen Yuksel iD

Sensors · 07.06.2026 · 26 (12) · 3638

DOI: 10.3390/s26123638 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 07.06.2026. Verfasst von Bahri Abaci und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Electronics Engineering, Hacettepe University, Ankara 06800, Turkey. Die Arbeit nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Hacettepe University, Hacettepe University Scientific Research Projects (BAP) Coordination Unit.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Infrared focal plane array detectors produce column stripe noise due to inter-detector response variations. Existing single-frame correction methods operate exclusively on the degraded infrared image and cannot reliably distinguish column noise from genuine vertical scene structures. With the increasing availability of co-registered visible-light cameras in modern electro-optical/infrared payloads, we propose to exploit the visible image as a structural guide for infrared destriping. Through a cross-modal correlation analysis, we show that the structural correspondence between RGB and infrared images is spatially non-uniform, motivating a selective rather than uniform fusion strategy. Based on this observation, we propose CMSP (Cross-Modal Scene Prior), a lightweight single-frame denoising architecture that selectively applies RGB guidance where it is beneficial. The proposed AdaptiveSPADE module blends RGB-guided modulation with standard instance normalization through a learned per-pixel confidence map, while a dual-path output head separately estimates pixel-wise residuals and column-constant stripe patterns. Evaluated on three public RGB–IR datasets, CMSP achieves 51.91 dB PSNR on M3FD, outperforming the best baseline by 5.79 dB with only 638 K parameters. A downstream evaluation on real stripe noise demonstrates that CMSP not only removes artifacts but also preserves the fine structures critical for infrared small target detection. Ablation studies confirm that adaptive gating more than doubles the benefit of RGB guidance compared to uniform modulation, and prevents degradation when cross-modal alignment is weak.

Schlagwörter

Stichwörter der Autor:innen

column stripe noisecross-modal guidancedeep learninginfrared imagingnon-uniformity correctionspatially adaptive normalizationvisible-light guidance

Autor:innen und Institutionen

  • Department of Electrical and Electronics Engineering, Hacettepe University, Ankara 06800, Turkey.
  • ASELSAN Inc., Ankara 06830, Turkey.

ORCID-Profile: Bahri Abaci, Seniha Esen Yuksel

Förderung

  • Hacettepe University
  • Hacettepe University Scientific Research Projects (BAP) Coordination Unit

Zitieren

APA

Abaci, B., & Yuksel, S. E. (2026). Cross-Modal Scene Prior for Adaptive RGB-Guided Infrared Column Stripe Noise Removal. Sensors, 26(12), 3638. https://doi.org/10.3390/s26123638

Vancouver

Abaci B, Yuksel SE. Cross-Modal Scene Prior for Adaptive RGB-Guided Infrared Column Stripe Noise Removal. Sensors. 2026;26(12):3638. doi:10.3390/s26123638

BibTeX
@article{Abaci2026,
  author = {Abaci, Bahri and Yuksel, Seniha Esen},
  title = {Cross-Modal Scene Prior for Adaptive RGB-Guided Infrared Column Stripe Noise Removal},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {12},
  pages = {3638},
  doi = {10.3390/s26123638}
}
Kostenlos starten →