A Comparative Benchmark of Large Language Models for Labelling Wind Turbine Maintenance Logs
IET Renewable Power Generation · 2026-01 · 20 (1)
DOI: 10.1049/rpg2.70212 ↗Kurz gefasst
Fachartikel in der Zeitschrift IET Renewable Power Generation, online erschienen am 23.02.2026. Verfasst von Max Malyi und 3 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 10 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Effective operation and maintenance (O&M) is critical to reducing the levelised cost of energy (LCOE) from wind power, yet the unstructured, free‐text nature of turbine maintenance logs presents a significant barrier to automated analysis. We address this by presenting a novel, reproducible framework for benchmarking large language models (LLMs) on classifying these complex industrial records, which is publicly available as an open‐source tool. We demonstrate the framework's utility by systematically evaluating a diverse suite of state‐of‐the‐art proprietary and open‐source LLMs, providing a practical case study for the foundational assessment of their trade‐offs in reliability, operational efficiency and model calibration. Benchmarked against a qualitatively selected high‐performing reasoning model, our study demonstrates how the tool quantifies a clear performance hierarchy to help analysts identify top models exhibiting high alignment and trustworthy confidence scores. Furthermore, we show that classification performance depends heavily on semantic ambiguity, with all models displaying higher consensus on objective component identification than on interpretive maintenance actions. Given that no model achieves perfect accuracy and calibration varies dramatically, we conclude the most responsible application is a human‐in‐the‐loop system where LLMs act as assistants to accelerate and standardise data labelling, enhancing O&M data quality and downstream reliability analysis.
Zitieren
APA
Malyi, M., Shek, J., McDonald, A., & Biscaya, A. (2026). A Comparative Benchmark of Large Language Models for Labelling Wind Turbine Maintenance Logs. IET Renewable Power Generation, 20(1). https://doi.org/10.1049/rpg2.70212
Vancouver
Malyi M, Shek J, McDonald A, Biscaya A. A Comparative Benchmark of Large Language Models for Labelling Wind Turbine Maintenance Logs. IET Renewable Power Generation. 2026;20(1). doi:10.1049/rpg2.70212
BibTeX
@article{Malyi2026,
author = {Malyi, Max and Shek, Jonathan and McDonald, Alasdair and Biscaya, André},
title = {A Comparative Benchmark of Large Language Models for Labelling Wind Turbine Maintenance Logs},
journal = {IET Renewable Power Generation},
year = {2026},
volume = {20},
number = {1},
doi = {10.1049/rpg2.70212}
}
EUVIMED