EUVIMEDEUVIMED entdecken
Crossref

Data Management for ML-Based Analytics and Beyond

Daniel Kang, John Guibas, Peter Bailis, Tatsunori Hashimoto, Yi Sun, Matei Zaharia

ACM / IMS Journal of Data Science · 2024

DOI: 10.1145/3611093 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM / IMS Journal of Data Science, 2024. Verfasst von Daniel Kang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 53 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The increasing capabilities of machine learning (ML) has enabled the deployment of ML methods in a variety of applications, ranging from unstructured data analytics to autonomous vehicles. Due to the volumes of data over which ML is deployed, it is infeasible for humans to monitor deployments: the Tesla fleet of vehicles produces exabytes of data and millions of hours of video per day. As a result, ML deployments can fail in unexpected and catastrophic ways. In this work, we highlight three important but underlooked aspects of ML deployment pipelines: (1) managing high-quality training data, (2) monitoring ML errors at deployment time, and (3) connecting end use to deployment algorithms. We first demonstrate that training labels are often erroneous, contrary to standard practice, even when labeled by leading vendors. We then demonstrate that standard methods of deploying ML methods can lead to downstream errors. As a first step toward addressing these issues, we review and contextualize two abstractions for finding errors in training data and deployments. We further describe how to improve algorithms for analytics queries as a case study for optimizing ML pipelines end to end.

Zitieren

APA

Kang, D., Guibas, J., Bailis, P., Hashimoto, T., Sun, Y., & Zaharia, M. (2024). Data Management for ML-Based Analytics and Beyond. ACM / IMS Journal of Data Science. https://doi.org/10.1145/3611093

Vancouver

Kang D, Guibas J, Bailis P, Hashimoto T, Sun Y, Zaharia M. Data Management for ML-Based Analytics and Beyond. ACM / IMS Journal of Data Science. 2024. doi:10.1145/3611093

BibTeX
@article{Kang2024,
  author = {Kang, Daniel and Guibas, John and Bailis, Peter and Hashimoto, Tatsunori and Sun, Yi and Zaharia, Matei},
  title = {Data Management for ML-Based Analytics and Beyond},
  journal = {ACM / IMS Journal of Data Science},
  year = {2024},
  doi = {10.1145/3611093}
}
Kostenlos starten →