EUVIMEDEUVIMED entdecken
Crossref

Deep Learning for the Production of Official Statistics: Density Ratio Estimation Using Biased Transaction Data for Japanese Labor Statistics

Yuya Takada, Yuri Murayama, Kiyoshi Izumi

Journal of Advanced Computational Intelligence and Intelligent Informatics · 20.07.2026 · 30 (4) · 1265-1278

DOI: 10.20965/jaciii.2026.p1265 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Advanced Computational Intelligence and Intelligent Informatics, online erschienen am 20.07.2026. Verfasst von Yuya Takada und 2 weiteren Autor:innen. Die Arbeit nennt 36 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

National statistical offices are exploring alternative data sources for official statistics. Such data, including point-of-sale (POS) records and mobile phone GPS logs, are originally collected for operational rather than statistical purposes. In the era of big data, the private sector accumulates vast volumes of transaction data, and leveraging such data for official statistics has become an emerging priority. However, these efforts face significant challenges, primarily due to severe selection bias stemming from such data. Prior research has shown that, even if non-representative, transaction data can produce timely statistics via density ratio estimation methods from machine learning. As a proof of concept, that study demonstrated that preliminary estimates could be generated using biased data from a Japanese private employment agency, enabling the early release of a labor market indicator otherwise delayed by up to a year. Building on this, the present study incorporates deep learning into density ratio estimation to improve accuracy. While deep learning, when applied to density ratio estimation, is often considered prone to overfitting, this study demonstrates that it can improve estimation accuracy without overfitting. Moreover, although deep learning is typically regarded as requiring extensive hyperparameter tuning, we show that it can be implemented without a significant tuning burden, supporting its practical use in the production of official statistics.

Zitieren

APA

Takada, Y., Murayama, Y., & Izumi, K. (2026). Deep Learning for the Production of Official Statistics: Density Ratio Estimation Using Biased Transaction Data for Japanese Labor Statistics. Journal of Advanced Computational Intelligence and Intelligent Informatics, 30(4), 1265-1278. https://doi.org/10.20965/jaciii.2026.p1265

Vancouver

Takada Y, Murayama Y, Izumi K. Deep Learning for the Production of Official Statistics: Density Ratio Estimation Using Biased Transaction Data for Japanese Labor Statistics. Journal of Advanced Computational Intelligence and Intelligent Informatics. 2026;30(4):1265-1278. doi:10.20965/jaciii.2026.p1265

BibTeX
@article{Takada2026,
  author = {Takada, Yuya and Murayama, Yuri and Izumi, Kiyoshi},
  title = {Deep Learning for the Production of Official Statistics: Density Ratio Estimation Using Biased Transaction Data for Japanese Labor Statistics},
  journal = {Journal of Advanced Computational Intelligence and Intelligent Informatics},
  year = {2026},
  volume = {30},
  number = {4},
  pages = {1265--1278},
  doi = {10.20965/jaciii.2026.p1265}
}
Kostenlos starten →