Vision-Based Environmental Sensing for Flood Risk Forecasting: Dataset Relabeling and Temporal Multi-Task Learning
Sensors · 02.06.2026 · 26 (11) · 3520
DOI: 10.3390/s26113520 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 02.06.2026. Verfasst von Seungju Lee und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Smart ICT Convergence Engineering, Seoul National University of Science and Technology, Seoul 01811, Republic of Korea. Die Arbeit nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Institute of Information & Communications Technology Planning & Evaluation.
Abstract (Originalsprache)
River flooding and urban inundation require forecasting systems that can anticipate future risk, rather than systems that only estimate the current water state. However, real-world closed-circuit television (CCTV)-based flood datasets often contain imbalanced or temporally inconsistent risk labels. In addition, most image-based approaches remain limited to static scene understanding. This study proposes a dataset reformulation and temporal multi-task forecasting framework for CCTV-based flood-risk prediction. First, we introduce a site-relative relabeling strategy that converts noisy frame-level danger annotations into four risk levels using visual flood indicators and lightweight environmental cues. Second, we transform the original frame-based dataset into site-hour sequences for multi-horizon forecasting at 1 h, 3 h, and 6 h. Third, we evaluate image-only, weather-only, and naive multimodal configurations to examine the role and limitations of heterogeneous sensor fusion. On the reformulated dataset, the image-only temporal model achieved the best overall performance, with a mean Intersection over Union (mIoU) of 0.892, Dice score of 0.940, macro-averaged F1 score (Macro-F1) of 0.532, and high-risk recall of 0.642. In contrast, naive multimodal fusion reduced Macro-F1 to 0.267 and high-risk recall to 0.070. This result indicates that additional weather inputs do not automatically improve prediction when cross-modal signals are noisy, weakly correlated, or temporally misaligned. The ablation results further showed that removing temporal modeling decreased Macro-F1 to 0.227 and high-risk recall to 0.000. These findings demonstrate that dataset reformulation and temporal modeling are essential for extending CCTV-based flood analysis from static estimation to future risk forecasting. They also suggest that robust cross-modal alignment is required before multimodal sensing can provide reliable performance gains.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Smart ICT Convergence Engineering, Seoul National University of Science and Technology, Seoul 01811, Republic of Korea.
ORCID-Profile: Seungju Lee, Gooman Park
Förderung
- Institute of Information & Communications Technology Planning & Evaluation
Zitieren
APA
Lee, S., & Park, G. (2026). Vision-Based Environmental Sensing for Flood Risk Forecasting: Dataset Relabeling and Temporal Multi-Task Learning. Sensors, 26(11), 3520. https://doi.org/10.3390/s26113520
Vancouver
Lee S, Park G. Vision-Based Environmental Sensing for Flood Risk Forecasting: Dataset Relabeling and Temporal Multi-Task Learning. Sensors. 2026;26(11):3520. doi:10.3390/s26113520
BibTeX
@article{Lee2026,
author = {Lee, Seungju and Park, Gooman},
title = {Vision-Based Environmental Sensing for Flood Risk Forecasting: Dataset Relabeling and Temporal Multi-Task Learning},
journal = {Sensors},
year = {2026},
volume = {26},
number = {11},
pages = {3520},
doi = {10.3390/s26113520}
}
EUVIMED