Ensemble of Vision Transformers for Sea State Classification
IEEE Journal of Oceanic Engineering · 2026-07 · 51 (3) · 2122-2136
DOI: 10.1109/joe.2026.3674388 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Journal of Oceanic Engineering, 2026-07. Verfasst von Marina Ivasic-Kos und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: HORIZON Europe Widening INNO2MARE Project, UNIRI Project SmartSeaGuard, Hrvatska Zaklada za Znanost.
Abstract (Originalsprache)
This study presents an innovative method for real-time sea state classification that utilizes an ensemble-based computer vision framework. Multiple pretrained submodels, each individually fine-tuned on specialized data sets, are integrated to recognize eight classes on the Beaufort scale. A comprehensive multimodal data set was assembled, combining visual information with wind speed data from anemometers and further optimized through preprocessing steps. Standalone models based on cutting-edge architectures, such as the data efficient vision transformer and EfficientNet deep convolutional network, were adapted specifically for sea state recognition. Initial results yielded F1 scores of 66% and 65%, respectively, for these models. To boost overall accuracy, a weighted majority voting and precision-driven ensemble strategy was adopted. The unimodal ensemble achieved 73% F1 score, while the multimodal ensemble, leveraging both image and wind data, reached an F1 score of 97%. For a reduced six-class scenario, where noncritical classes were grouped, the unimodal ensemble reached an impressive F1 score of 94%. These outcomes illustrate the potential of this ensemble approach to significantly advance maritime safety and operational efficiency in sea state monitoring.
Förderung
- HORIZON Europe Widening INNO2MARE Project
- UNIRI Project SmartSeaGuard
- Hrvatska Zaklada za Znanost
Zitieren
APA
Ivasic-Kos, M., Palinic, D., & Pobar, M. (2026). Ensemble of Vision Transformers for Sea State Classification. IEEE Journal of Oceanic Engineering, 51(3), 2122-2136. https://doi.org/10.1109/joe.2026.3674388
Vancouver
Ivasic-Kos M, Palinic D, Pobar M. Ensemble of Vision Transformers for Sea State Classification. IEEE Journal of Oceanic Engineering. 2026;51(3):2122-2136. doi:10.1109/joe.2026.3674388
BibTeX
@article{IvasicKos2026,
author = {Ivasic-Kos, Marina and Palinic, Domagoj and Pobar, Miran},
title = {Ensemble of Vision Transformers for Sea State Classification},
journal = {IEEE Journal of Oceanic Engineering},
year = {2026},
volume = {51},
number = {3},
pages = {2122--2136},
doi = {10.1109/joe.2026.3674388}
}
EUVIMED