EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An Automated Domain-Agnostic and Explainable Data Quality Assurance Framework for Energy Analytics and Beyond

Balázs András Tolnai, Zhipeng Ma, Bo Nørregaard Jørgensen, Zheng Grace Ma

Information · 26.09.2025 · 16 (10) · 836

DOI: 10.3390/info16100836 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Information, online erschienen am 26.09.2025. Verfasst von Balázs András Tolnai und 3 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: ADRENALIN (Data-driven smart buildings: data sandbox and competition) project, Energy Technology Development and Demonstration Programme (EUDP) in Denmark.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Nonintrusive load monitoring (NILM) relies on high-resolution sensor data to disaggregate total building energy into end-use load components, for example HVAC, ventilation, and appliances. On the ADRENALIN corpus, simple NaN handling with forward fill and mean substitution reduced average NMAE from 0.82 to 0.76 for the Bayesian baseline, from 0.71 to 0.64 for BI-LSTM, and from 0.59 to 0.53 for the Time–Frequency Mask (TFM) model, across nine buildings and four temporal resolutions. However, many NILM models still show degraded accuracy due to unresolved data-quality issues, especially missing values, timestamp irregularities, and sensor inconsistencies, a limitation underexplored in current benchmarks. This paper presents a fully automated data-quality assurance pipeline for time-series energy datasets. The pipeline performs multivariate profiling, statistical analysis, and threshold-based diagnostics to compute standardized quality metrics, which are aggregated into an interpretable Building Quality Score (BQS) that predicts NILM performance and supports dataset ranking and selection. Explainability is provided by SHAP and a lightweight large language model, which turns visual diagnostics into concise, actionable narratives. The study evaluates practical quality improvement through systematic handling of missing values, linking metric changes to downstream error reduction. Using random-forest surrogates, SHAP identifies missingness and timestamp irregularity as dominant drivers of error across models. Core contributions include the definition and validation of BQS, an interpretable scoring and explanation framework for time-series quality, and an end-to-end evaluation of how quality diagnostics affect NILM performance at scale.

Förderung

  • ADRENALIN (Data-driven smart buildings: data sandbox and competition) project
  • Energy Technology Development and Demonstration Programme (EUDP) in Denmark

Zitieren

APA

Tolnai, B. A., Ma, Z., Jørgensen, B. N., & Ma, Z. G. (2025). An Automated Domain-Agnostic and Explainable Data Quality Assurance Framework for Energy Analytics and Beyond. Information, 16(10), 836. https://doi.org/10.3390/info16100836

Vancouver

Tolnai BA, Ma Z, Jørgensen BN, Ma ZG. An Automated Domain-Agnostic and Explainable Data Quality Assurance Framework for Energy Analytics and Beyond. Information. 2025;16(10):836. doi:10.3390/info16100836

BibTeX
@article{Tolnai2025,
  author = {Tolnai, Balázs András and Ma, Zhipeng and Jørgensen, Bo Nørregaard and Ma, Zheng Grace},
  title = {An Automated Domain-Agnostic and Explainable Data Quality Assurance Framework for Energy Analytics and Beyond},
  journal = {Information},
  year = {2025},
  volume = {16},
  number = {10},
  pages = {836},
  doi = {10.3390/info16100836}
}
Kostenlos starten →