Input Serialization in Zero-Shot LLM Fault Diagnosis of Rooftop Units: A Leakage-Controlled Evaluation of Nine Models
Intelligent Infrastructure and Construction · 12.11.2026 · 2 (4) · 17
DOI: 10.3390/iic2040017 ↗Kurz gefasst
Fachartikel in der Zeitschrift Intelligent Infrastructure and Construction, online erschienen am 12.11.2026. Verfasst von Kang Lai und 2 weiteren Autor:innen. Die Arbeit nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Large language models are increasingly used for building fault diagnosis, but input representation is often changed alongside model adaptation or added knowledge. This study isolates serialization effects using matched rooftop unit measurements rendered as deterministic prose, fixed schema JSON, and JSON with a fixed evidence card covering all classes. Nine API models evaluated 240 windows from 39 source files in the public ORNL_RTU dataset across four diagnostic classes. Prompt development was separated from evaluation by season, and uncertainty was assessed at the source file level. Observed macro F1 differences between JSON and prose ranged from −0.082 to 0.029, and no model-specific contrast remained significant after Holm adjustment, which does not establish equivalence. Output validity nevertheless varied: JSON reduced the MiniMax invalid schema rate by 0.333, the evidence card increased Kimi diagnostic coverage by 0.508, and larger macro F1 changes coincided with changes in schema validity or abstention. Model condition macro F1 ranged from zero to 0.182, compared with 0.543 for a supervised Random Forest reference under seasonal holdout, so no evaluated zero-shot configuration is suitable for unattended fault classification. Diagnostic accuracy, schema validity, abstention, and name-level evidence grounding should therefore be evaluated jointly when selecting input representations.
Zitieren
APA
Lai, K., Hu, W., & Cai, Y. (2026). Input Serialization in Zero-Shot LLM Fault Diagnosis of Rooftop Units: A Leakage-Controlled Evaluation of Nine Models. Intelligent Infrastructure and Construction, 2(4), 17. https://doi.org/10.3390/iic2040017
Vancouver
Lai K, Hu W, Cai Y. Input Serialization in Zero-Shot LLM Fault Diagnosis of Rooftop Units: A Leakage-Controlled Evaluation of Nine Models. Intelligent Infrastructure and Construction. 2026;2(4):17. doi:10.3390/iic2040017
BibTeX
@article{Lai2026,
author = {Lai, Kang and Hu, Wei and Cai, Yiyu},
title = {Input Serialization in Zero-Shot LLM Fault Diagnosis of Rooftop Units: A Leakage-Controlled Evaluation of Nine Models},
journal = {Intelligent Infrastructure and Construction},
year = {2026},
volume = {2},
number = {4},
pages = {17},
doi = {10.3390/iic2040017}
}
EUVIMED