Vision transformer-based automatic weather detection with adaptive transfer learning using Bayesian optimization and genetic algorithm
RAIRO - Operations Research · 2026-07 · 60 (4) · 2021-2042
DOI: 10.1051/ro/2026053 ↗Kurz gefasst
Fachartikel in der Zeitschrift RAIRO - Operations Research, online erschienen am 13.07.2026. Verfasst von Walid Hariri und 1 weiteren Autor:innen. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Recognizing weather patterns plays a vital role in numerous areas of daily life, including weather forecasting, transportation, agriculture, and forest management. Machine learning approaches, particularly Convolutional Neural Networks (CNNs), offer improved weather pattern analysis compared to traditional radar systems. However, CNNs struggle to capture multi-level dependencies without increasing model complexity. Recently, Vision Transformers (ViT), adapted from Natural Language Processing, have demonstrated superior performance in capturing global image relationships. This study presents a deep learning approach to accurately detect and classify weather conditions into multiple categories through transfer learning. To tackle the challenge of selecting the optimal number of trainable layers in CNNs and blocks in ViTs, an Adaptive Layer Freezing (ALF) technique is introduced, dynamically modifying the trainable layers to maximize efficiency during transfer learning with the help of Bayesian Optimization (BO). BO, widely recognized for its capability in hyperparameter tuning, ensures the ALF process operates with optimal configurations, enhancing both training efficiency and model accuracy. We compare BO with Genetic Algorithms (GA), a robust metaheuristic inspired by natural selection. Experimental results show that GA achieves slightly lower accuracy than BO. A new architecture based on ViT-L32 is evaluated against two CNN models – EfficientNetB0 and MobileNetV2 – using two weather imaging datasets (WEAPD and WCD), with ViT-L32 achieving the best classification results, attaining 98.28% accuracy for binary and 96.45% for multi-class classifications.
Zitieren
APA
Hariri, W., & Boumezaid, M. A. (2026). Vision transformer-based automatic weather detection with adaptive transfer learning using Bayesian optimization and genetic algorithm. RAIRO - Operations Research, 60(4), 2021-2042. https://doi.org/10.1051/ro/2026053
Vancouver
Hariri W, Boumezaid MA. Vision transformer-based automatic weather detection with adaptive transfer learning using Bayesian optimization and genetic algorithm. RAIRO - Operations Research. 2026;60(4):2021-2042. doi:10.1051/ro/2026053
BibTeX
@article{Hariri2026,
author = {Hariri, Walid and Boumezaid, Mohamed Abdelbassat},
title = {Vision transformer-based automatic weather detection with adaptive transfer learning using Bayesian optimization and genetic algorithm},
journal = {RAIRO - Operations Research},
year = {2026},
volume = {60},
number = {4},
pages = {2021--2042},
doi = {10.1051/ro/2026053}
}
EUVIMED