EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Ensemble of Vision Transformers for Sea State Classification

Marina Ivasic-Kos, Domagoj Palinic, Miran Pobar

IEEE Journal of Oceanic Engineering · 2026-07 · 51 (3) · 2122-2136

DOI: 10.1109/joe.2026.3674388 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Journal of Oceanic Engineering, 2026-07. Verfasst von Marina Ivasic-Kos und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: HORIZON Europe Widening INNO2MARE Project, UNIRI Project SmartSeaGuard, Hrvatska Zaklada za Znanost.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study presents an innovative method for real-time sea state classification that utilizes an ensemble-based computer vision framework. Multiple pretrained submodels, each individually fine-tuned on specialized data sets, are integrated to recognize eight classes on the Beaufort scale. A comprehensive multimodal data set was assembled, combining visual information with wind speed data from anemometers and further optimized through preprocessing steps. Standalone models based on cutting-edge architectures, such as the data efficient vision transformer and EfficientNet deep convolutional network, were adapted specifically for sea state recognition. Initial results yielded F1 scores of 66% and 65%, respectively, for these models. To boost overall accuracy, a weighted majority voting and precision-driven ensemble strategy was adopted. The unimodal ensemble achieved 73% F1 score, while the multimodal ensemble, leveraging both image and wind data, reached an F1 score of 97%. For a reduced six-class scenario, where noncritical classes were grouped, the unimodal ensemble reached an impressive F1 score of 94%. These outcomes illustrate the potential of this ensemble approach to significantly advance maritime safety and operational efficiency in sea state monitoring.

Förderung

  • HORIZON Europe Widening INNO2MARE Project
  • UNIRI Project SmartSeaGuard
  • Hrvatska Zaklada za Znanost

Zitieren

APA

Ivasic-Kos, M., Palinic, D., & Pobar, M. (2026). Ensemble of Vision Transformers for Sea State Classification. IEEE Journal of Oceanic Engineering, 51(3), 2122-2136. https://doi.org/10.1109/joe.2026.3674388

Vancouver

Ivasic-Kos M, Palinic D, Pobar M. Ensemble of Vision Transformers for Sea State Classification. IEEE Journal of Oceanic Engineering. 2026;51(3):2122-2136. doi:10.1109/joe.2026.3674388

BibTeX
@article{IvasicKos2026,
  author = {Ivasic-Kos, Marina and Palinic, Domagoj and Pobar, Miran},
  title = {Ensemble of Vision Transformers for Sea State Classification},
  journal = {IEEE Journal of Oceanic Engineering},
  year = {2026},
  volume = {51},
  number = {3},
  pages = {2122--2136},
  doi = {10.1109/joe.2026.3674388}
}
Kostenlos starten →