EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Knowledge Distillation for Improving Deep Learning‐Based Hydrological Prediction and Fine‐Tuning

M. S. Jahangir, J. Quilty, S. Steinschneider, J. Adamowski

Journal of Geophysical Research: Machine Learning and Computation · 2026-06 · 3 (3)

DOI: 10.1029/2025jh001081 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Geophysical Research: Machine Learning and Computation, online erschienen am 03.06.2026. Verfasst von M. S. Jahangir und 3 weiteren Autor:innen. Die Arbeit nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Natural Resources Canada, Natural Sciences and Engineering Research Council of Canada.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper introduces knowledge distillation (KD) as a method for improving deep learning (DL)‐based hydrological prediction. The performance of DL models, including long short‐term memory networks (LSTMs), is highly dependent on model structure and training data quality, posing challenges for transfer learning. In the KD framework, a better “teacher” model, trained with higher‐quality input data or constructed as an ensemble, is used to guide the training of a weaker “student” model. This enables improved performance in situations where input data quality or computational resources are limited. We demonstrate the effectiveness of KD in two experiments conducted across 421 catchments throughout the contiguous United States, where LSTM models use daily basin‐averaged meteorological forcings to predict daily streamflow. In the first experiment, KD was applied to improve streamflow prediction when lower‐quality ERA5‐Land reanalysis meteorological inputs were used instead of higher‐quality Daymet observations. This experiment is relevant to forecasting applications, where lower quality (e.g., lower resolution) precipitation forecasts are used to force a DL‐based hydrologic model optimized with high‐resolution observed precipitation. Results demonstrate that KD leads to substantial performance improvements, especially for catchments not used in training (>25% improvement in median Nash‐Sutcliffe efficiency (NSE)). In the second experiment, KD is applied for model compression, distilling the knowledge of an ensemble of five LSTM models into a single model that substantially outperforms LSTMs trained without KD. These findings underscore the value of KD in optimizing DL models for hydrological prediction, offering a model‐agnostic and scalable approach that facilitates efficiency and model transferability.

Förderung

  • Natural Resources Canada
  • Natural Sciences and Engineering Research Council of Canada

Zitieren

APA

Jahangir, M. S., Quilty, J., Steinschneider, S., & Adamowski, J. (2026). Knowledge Distillation for Improving Deep Learning‐Based Hydrological Prediction and Fine‐Tuning. Journal of Geophysical Research: Machine Learning and Computation, 3(3). https://doi.org/10.1029/2025jh001081

Vancouver

Jahangir MS, Quilty J, Steinschneider S, Adamowski J. Knowledge Distillation for Improving Deep Learning‐Based Hydrological Prediction and Fine‐Tuning. Journal of Geophysical Research: Machine Learning and Computation. 2026;3(3). doi:10.1029/2025jh001081

BibTeX
@article{Jahangir2026,
  author = {Jahangir, M. S. and Quilty, J. and Steinschneider, S. and Adamowski, J.},
  title = {Knowledge Distillation for Improving Deep Learning‐Based Hydrological Prediction and Fine‐Tuning},
  journal = {Journal of Geophysical Research: Machine Learning and Computation},
  year = {2026},
  volume = {3},
  number = {3},
  doi = {10.1029/2025jh001081}
}
Kostenlos starten →