EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

FireMM-IR: An Infrared-Enhanced Multi-Modal Large Language Model for Comprehensive Scene Understanding in Remote Sensing Forest Fire Monitoring

Jinghao Cao, Xiajun Liu, Rui Xue

Sensors · 07.01.2026 · 26 (2) · 390

DOI: 10.3390/s26020390 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 07.01.2026. Verfasst von Jinghao Cao und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechanical Engineering, Jiangsu University of Science and Technology, Zhenjiang 212000, China. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Forest fire monitoring in remote sensing imagery has long relied on traditional perception models that primarily focus on detection or segmentation. However, such approaches fall short in understanding complex fire dynamics, including contextual reasoning, fire evolution description, and cross-modal interpretation. With the rise of multi-modal large language models (MLLMs), it becomes possible to move beyond low-level perception toward holistic scene understanding that jointly reasons about semantics, spatial distribution, and descriptive language. To address this gap, we introduce FireMM-IR, a multi-modal large language model tailored for pixel-level scene understanding in remote-sensing forest-fire imagery. FireMM-IR incorporates an infrared-enhanced classification module that fuses infrared and visual modalities, enabling the model to capture fire intensity and hidden ignition areas under dense smoke. Furthermore, we design a mask-generation module guided by language-conditioned segmentation tokens to produce accurate instance masks from natural-language queries. To effectively learn multi-scale fire features, a class-aware memory mechanism is introduced to maintain contextual consistency across diverse fire scenes. We also construct FireMM-Instruct, a unified corpus of 83,000 geometrically aligned RGB–IR pairs with instruction-aligned descriptions, bounding boxes, and pixel-level annotations. Extensive experiments show that FireMM-IR achieves superior performance on pixel-level segmentation and strong results on instruction-driven captioning and reasoning, while maintaining competitive performance on image-level benchmarks. These results indicate that infrared–optical fusion and instruction-aligned learning are key to physically grounded understanding of wildfire scenes.

Schlagwörter

Stichwörter der Autor:innen

forest fire understandinginfrared-aidedmulti-modal large language model

Autor:innen und Institutionen

  • School of Mechanical Engineering, Jiangsu University of Science and Technology, Zhenjiang 212000, China.
  • School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China.
  • School of Internet of Things Engineering, Jiangnan University, Wuxi 214122, China.
  • School of Energy and Power Engineering, Nanjing Institute of Technology, Nanjing 211167, China.

Zitieren

APA

Cao, J., Liu, X., & Xue, R. (2026). FireMM-IR: An Infrared-Enhanced Multi-Modal Large Language Model for Comprehensive Scene Understanding in Remote Sensing Forest Fire Monitoring. Sensors, 26(2), 390. https://doi.org/10.3390/s26020390

Vancouver

Cao J, Liu X, Xue R. FireMM-IR: An Infrared-Enhanced Multi-Modal Large Language Model for Comprehensive Scene Understanding in Remote Sensing Forest Fire Monitoring. Sensors. 2026;26(2):390. doi:10.3390/s26020390

BibTeX
@article{Cao2026,
  author = {Cao, Jinghao and Liu, Xiajun and Xue, Rui},
  title = {FireMM-IR: An Infrared-Enhanced Multi-Modal Large Language Model for Comprehensive Scene Understanding in Remote Sensing Forest Fire Monitoring},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {2},
  pages = {390},
  doi = {10.3390/s26020390}
}
Kostenlos starten →