An Automated Domain-Agnostic and Explainable Data Quality Assurance Framework for Energy Analytics and Beyond
Information · 26.09.2025 · 16 (10) · 836
DOI: 10.3390/info16100836 ↗Kurz gefasst
Fachartikel in der Zeitschrift Information, online erschienen am 26.09.2025. Verfasst von Balázs András Tolnai und 3 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: ADRENALIN (Data-driven smart buildings: data sandbox and competition) project, Energy Technology Development and Demonstration Programme (EUDP) in Denmark.
Abstract (Originalsprache)
Nonintrusive load monitoring (NILM) relies on high-resolution sensor data to disaggregate total building energy into end-use load components, for example HVAC, ventilation, and appliances. On the ADRENALIN corpus, simple NaN handling with forward fill and mean substitution reduced average NMAE from 0.82 to 0.76 for the Bayesian baseline, from 0.71 to 0.64 for BI-LSTM, and from 0.59 to 0.53 for the Time–Frequency Mask (TFM) model, across nine buildings and four temporal resolutions. However, many NILM models still show degraded accuracy due to unresolved data-quality issues, especially missing values, timestamp irregularities, and sensor inconsistencies, a limitation underexplored in current benchmarks. This paper presents a fully automated data-quality assurance pipeline for time-series energy datasets. The pipeline performs multivariate profiling, statistical analysis, and threshold-based diagnostics to compute standardized quality metrics, which are aggregated into an interpretable Building Quality Score (BQS) that predicts NILM performance and supports dataset ranking and selection. Explainability is provided by SHAP and a lightweight large language model, which turns visual diagnostics into concise, actionable narratives. The study evaluates practical quality improvement through systematic handling of missing values, linking metric changes to downstream error reduction. Using random-forest surrogates, SHAP identifies missingness and timestamp irregularity as dominant drivers of error across models. Core contributions include the definition and validation of BQS, an interpretable scoring and explanation framework for time-series quality, and an end-to-end evaluation of how quality diagnostics affect NILM performance at scale.
Förderung
- ADRENALIN (Data-driven smart buildings: data sandbox and competition) project
- Energy Technology Development and Demonstration Programme (EUDP) in Denmark
Zitieren
APA
Tolnai, B. A., Ma, Z., Jørgensen, B. N., & Ma, Z. G. (2025). An Automated Domain-Agnostic and Explainable Data Quality Assurance Framework for Energy Analytics and Beyond. Information, 16(10), 836. https://doi.org/10.3390/info16100836
Vancouver
Tolnai BA, Ma Z, Jørgensen BN, Ma ZG. An Automated Domain-Agnostic and Explainable Data Quality Assurance Framework for Energy Analytics and Beyond. Information. 2025;16(10):836. doi:10.3390/info16100836
BibTeX
@article{Tolnai2025,
author = {Tolnai, Balázs András and Ma, Zhipeng and Jørgensen, Bo Nørregaard and Ma, Zheng Grace},
title = {An Automated Domain-Agnostic and Explainable Data Quality Assurance Framework for Energy Analytics and Beyond},
journal = {Information},
year = {2025},
volume = {16},
number = {10},
pages = {836},
doi = {10.3390/info16100836}
}
EUVIMED