Data Lifecycle Challenges in Production Machine Learning
ACM SIGMOD Record · 11.12.2018 · 47 (2) · 17-28
DOI: 10.1145/3299887.3299891 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM SIGMOD Record, online erschienen am 11.12.2018. Verfasst von Neoklis Polyzotis und 3 weiteren Autor:innen. Die Arbeit wurde bisher 209-mal zitiert (Crossref) und nennt 74 Literaturangaben.
Abstract (Originalsprache)
Machine learning has become an essential tool for gleaning knowledge from data and tackling a diverse set of computationally hard tasks. However, the accuracy of a machine learned model is deeply tied to the data that it is trained on. Designing and building robust processes and tools that make it easier to analyze, validate, and transform data that is fed into large-scale machine learning systems poses data management challenges. Drawn from our experience in developing data-centric infrastructure for a production machine learning platform at Google, we summarize some of the interesting research challenges that we encountered, and survey some of the relevant literature from the data management and machine learning communities. Specifically, we explore challenges in three main areas of focus - data understanding, data validation and cleaning, and data preparation. In each of these areas, we try to explore how different constraints are imposed on the solutions depending on where in the lifecycle of a model the problems are encountered and who encounters them.
Zitieren
APA
Polyzotis, N., Roy, S., Whang, S. E., & Zinkevich, M. (2018). Data Lifecycle Challenges in Production Machine Learning. ACM SIGMOD Record, 47(2), 17-28. https://doi.org/10.1145/3299887.3299891
Vancouver
Polyzotis N, Roy S, Whang SE, Zinkevich M. Data Lifecycle Challenges in Production Machine Learning. ACM SIGMOD Record. 2018;47(2):17-28. doi:10.1145/3299887.3299891
BibTeX
@article{Polyzotis2018,
author = {Polyzotis, Neoklis and Roy, Sudip and Whang, Steven Euijong and Zinkevich, Martin},
title = {Data Lifecycle Challenges in Production Machine Learning},
journal = {ACM SIGMOD Record},
year = {2018},
volume = {47},
number = {2},
pages = {17--28},
doi = {10.1145/3299887.3299891}
}
EUVIMED