Data Quality and Predictive Analytics in Official Statistics: An Asymmetric Hybrid Estimator for Poverty Estimation Under MNAR Measurement Error
Analytics · 03.11.2026 · 5 (4) · 47
DOI: 10.3390/analytics5040047 ↗Kurz gefasst
Fachartikel in der Zeitschrift Analytics, online erschienen am 03.11.2026. Verfasst von Rita Lima. Die Arbeit nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Can predictive algorithms trained on survey data affected by systematic measurement error meet official statistics quality standards? This study examines the tension between design-based inference and algorithmic modelling in poverty estimation, focusing on regressive income underreporting in the Italian shadow economy.
Methods
A Monte Carlo microsimulation protocol of 1000 replications is calibrated on ISTAT and EU-SILC 2025 statistics. The shadow economy is formalised as Missing Not At Random measurement error with spatial heteroscedasticity across three Italian macro-regions. Five estimators—design-based, algorithmic, and hybrid—are compared and audited through the QOSU framework.
Results
The GREG retains asymptotic design-unbiasedness on undistorted data but exhibits bias up to +29% on observed data, showing that calibration is insufficient under non-ignorable error. Uncalibrated machine learning estimators display systematic bias via shrinkage or amplification, termed statistical hallucination. The Asymmetric Hybrid, with a parameter-free quadratic weighting function, achieves GOLD in five of six domain–indicator combinations; a hold-out validation identifies a reliability threshold of 0.70 as the framework’s domain of validity.
Conclusions
Integrating machine learning into official statistics requires an adaptive architecture in which each component’s contribution is modulated by the reliability of the information base. The QOSU framework provides a reproducible protocol for auditing algorithmic estimates under non-ignorable measurement error.
Zitieren
APA
Lima, R. (2026). Data Quality and Predictive Analytics in Official Statistics: An Asymmetric Hybrid Estimator for Poverty Estimation Under MNAR Measurement Error. Analytics, 5(4), 47. https://doi.org/10.3390/analytics5040047
Vancouver
Lima R. Data Quality and Predictive Analytics in Official Statistics: An Asymmetric Hybrid Estimator for Poverty Estimation Under MNAR Measurement Error. Analytics. 2026;5(4):47. doi:10.3390/analytics5040047
BibTeX
@article{Lima2026,
author = {Lima, Rita},
title = {Data Quality and Predictive Analytics in Official Statistics: An Asymmetric Hybrid Estimator for Poverty Estimation Under MNAR Measurement Error},
journal = {Analytics},
year = {2026},
volume = {5},
number = {4},
pages = {47},
doi = {10.3390/analytics5040047}
}
EUVIMED