EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Vision transformer-based automatic weather detection with adaptive transfer learning using Bayesian optimization and genetic algorithm

Walid Hariri, Mohamed Abdelbassat Boumezaid

RAIRO - Operations Research · 2026-07 · 60 (4) · 2021-2042

DOI: 10.1051/ro/2026053 ↗

Kurz gefasst

Fachartikel in der Zeitschrift RAIRO - Operations Research, online erschienen am 13.07.2026. Verfasst von Walid Hariri und 1 weiteren Autor:innen. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recognizing weather patterns plays a vital role in numerous areas of daily life, including weather forecasting, transportation, agriculture, and forest management. Machine learning approaches, particularly Convolutional Neural Networks (CNNs), offer improved weather pattern analysis compared to traditional radar systems. However, CNNs struggle to capture multi-level dependencies without increasing model complexity. Recently, Vision Transformers (ViT), adapted from Natural Language Processing, have demonstrated superior performance in capturing global image relationships. This study presents a deep learning approach to accurately detect and classify weather conditions into multiple categories through transfer learning. To tackle the challenge of selecting the optimal number of trainable layers in CNNs and blocks in ViTs, an Adaptive Layer Freezing (ALF) technique is introduced, dynamically modifying the trainable layers to maximize efficiency during transfer learning with the help of Bayesian Optimization (BO). BO, widely recognized for its capability in hyperparameter tuning, ensures the ALF process operates with optimal configurations, enhancing both training efficiency and model accuracy. We compare BO with Genetic Algorithms (GA), a robust metaheuristic inspired by natural selection. Experimental results show that GA achieves slightly lower accuracy than BO. A new architecture based on ViT-L32 is evaluated against two CNN models – EfficientNetB0 and MobileNetV2 – using two weather imaging datasets (WEAPD and WCD), with ViT-L32 achieving the best classification results, attaining 98.28% accuracy for binary and 96.45% for multi-class classifications.

Zitieren

APA

Hariri, W., & Boumezaid, M. A. (2026). Vision transformer-based automatic weather detection with adaptive transfer learning using Bayesian optimization and genetic algorithm. RAIRO - Operations Research, 60(4), 2021-2042. https://doi.org/10.1051/ro/2026053

Vancouver

Hariri W, Boumezaid MA. Vision transformer-based automatic weather detection with adaptive transfer learning using Bayesian optimization and genetic algorithm. RAIRO - Operations Research. 2026;60(4):2021-2042. doi:10.1051/ro/2026053

BibTeX
@article{Hariri2026,
  author = {Hariri, Walid and Boumezaid, Mohamed Abdelbassat},
  title = {Vision transformer-based automatic weather detection with adaptive transfer learning using Bayesian optimization and genetic algorithm},
  journal = {RAIRO - Operations Research},
  year = {2026},
  volume = {60},
  number = {4},
  pages = {2021--2042},
  doi = {10.1051/ro/2026053}
}
Kostenlos starten →