EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

ModalFormer: Multimodal Transformer for Low-Light Image Enhancement

Alexandru Brateanu, Raul Balmez, Ciprian Orhei, Codruta Ancuti, Cosmin Ancuti

Journal of Imaging · 09.11.2026 · 12 (11) · 566

DOI: 10.3390/jimaging12110566 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Imaging, online erschienen am 09.11.2026. Verfasst von Alexandru Brateanu und 4 weiteren Autor:innen. Die Arbeit nennt 88 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Low-light image enhancement (LLIE) is a fundamental yet challenging task due to the presence of noise, loss of detail, and poor contrast in images captured under insufficient lighting conditions. Recent methods often rely solely on pixel-level transformations of RGB images, neglecting the rich contextual information available from multiple visual modalities. In this paper, we present ModalFormer, a multimodal framework for LLIE that uses nine auxiliary representations derived from the input RGB image. Our model comprises two main components: a Cross-Modal Transformer (CM-T) designed to restore corrupted images while seamlessly integrating multimodal information, and multiple auxiliary subnetworks dedicated to multimodal feature reconstruction. Central to the CM-T is our novel Cross-Modal Multi-Headed Self-Attention (CM-MSA) mechanism, which effectively fuses RGB data with modality-specific features—including deep feature embeddings, segmentation information, geometric cues, and color information—to generate information-rich hybrid attention maps. Extensive experiments on multiple benchmark datasets demonstrate ModalFormer’s state-of-the-art performance in LLIE.

Zitieren

APA

Brateanu, A., Balmez, R., Orhei, C., Ancuti, C., & Ancuti, C. (2026). ModalFormer: Multimodal Transformer for Low-Light Image Enhancement. Journal of Imaging, 12(11), 566. https://doi.org/10.3390/jimaging12110566

Vancouver

Brateanu A, Balmez R, Orhei C, Ancuti C, Ancuti C. ModalFormer: Multimodal Transformer for Low-Light Image Enhancement. Journal of Imaging. 2026;12(11):566. doi:10.3390/jimaging12110566

BibTeX
@article{Brateanu2026,
  author = {Brateanu, Alexandru and Balmez, Raul and Orhei, Ciprian and Ancuti, Codruta and Ancuti, Cosmin},
  title = {ModalFormer: Multimodal Transformer for Low-Light Image Enhancement},
  journal = {Journal of Imaging},
  year = {2026},
  volume = {12},
  number = {11},
  pages = {566},
  doi = {10.3390/jimaging12110566}
}
Kostenlos starten →