EUVIMEDEUVIMED entdecken
Crossref

Quality issues in machine learning software systems

Pierre-Olivier Côté, Amin Nikanjam, Rached Bouchoucha, Ilan Basta, Mouna Abidi, Foutse Khomh

Empirical Software Engineering · 2024-11 · 29 (6)

DOI: 10.1007/s10664-024-10536-7 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Empirical Software Engineering, online erschienen am 11.09.2024. Verfasst von Pierre-Olivier Côté und 5 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 73 Literaturangaben. Gefördert von: NSERC, Prompt.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

An increasing demand is observed in various domains to employ Machine Learning (ML) for solving complex problems. ML models are implemented as software components and deployed in Machine Learning Software Systems (MLSSs). There is a strong need for ensuring the serving quality of MLSSs. False or poor decisions of such systems can lead to malfunction of other systems, significant financial losses, or even threats to human life. The quality assurance of MLSSs is considered a challenging task and currently is a hot research topic. This paper aims to investigate the characteristics of real quality issues in MLSSs from the viewpoint of practitioners. This empirical study aims to identify a catalog of quality issues in MLSSs. We conduct a set of interviews with practitioners/experts, to gather insights about their experience and practices when dealing with quality issues. We validate the identified quality issues via a survey with ML practitioners. Based on the content of 37 interviews, we identified 18 recurring quality issues and 24 strategies to mitigate them. For each identified issue, we describe the causes and consequences according to the practitioners’ experience. We believe the catalog of issues developed in this study will allow the community to develop efficient quality assurance tools for ML models and MLSSs. A replication package of our study is available on our public GitHub repository.

Förderung

  • NSERC
  • Prompt

Zitieren

APA

Côté, P., Nikanjam, A., Bouchoucha, R., Basta, I., Abidi, M., & Khomh, F. (2024). Quality issues in machine learning software systems. Empirical Software Engineering, 29(6). https://doi.org/10.1007/s10664-024-10536-7

Vancouver

Côté P, Nikanjam A, Bouchoucha R, Basta I, Abidi M, Khomh F. Quality issues in machine learning software systems. Empirical Software Engineering. 2024;29(6). doi:10.1007/s10664-024-10536-7

BibTeX
@article{Ct2024,
  author = {Côté, Pierre-Olivier and Nikanjam, Amin and Bouchoucha, Rached and Basta, Ilan and Abidi, Mouna and Khomh, Foutse},
  title = {Quality issues in machine learning software systems},
  journal = {Empirical Software Engineering},
  year = {2024},
  volume = {29},
  number = {6},
  doi = {10.1007/s10664-024-10536-7}
}
Kostenlos starten →