EUVIMEDEUVIMED entdecken
Scoping ReviewOpen Access

Deep learning with noisy labels in medical prediction problems: a scoping review

Yishu Wei, Yu Deng, Cong Sun, Mingquan Lin iD, Hongmei Jiang, Yifan Peng iD

Journal of the American Medical Informatics Association · 20.06.2024 · 31 (7) · 1596-1607

DOI: 10.1093/jamia/ocae108 ↗

Kurz gefasst

Scoping Review in der Zeitschrift Journal of the American Medical Informatics Association, online erschienen am 30.05.2024. Verfasst von Yishu Wei und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Population Health Sciences, Weill Cornell Medicine, New York, NY 10065, United States. Hauptthemen laut MEDLINE: Deep Learning. Die Arbeit wurde bisher 44-mal zitiert (Crossref) und nennt 84 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NLM NIH HHS, National Science Foundation, National Library of Medicine.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objectives

Medical research faces substantial challenges from noisy labels attributed to factors like inter-expert variability and machine-extracted labels. Despite this, the adoption of label noise management remains limited, and label noise is largely ignored. To this end, there is a critical need to conduct a scoping review focusing on the problem space. This scoping review aims to comprehensively review label noise management in deep learning-based medical prediction problems, which includes label noise detection, label noise handling, and evaluation. Research involving label uncertainty is also included.

Methods

Our scoping review follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. We searched 4 databases, including PubMed, IEEE Xplore, Google Scholar, and Semantic Scholar. Our search terms include “noisy label AND medical/healthcare/clinical,” “uncertainty AND medical/healthcare/clinical,” and “noise AND medical/healthcare/clinical.” Results A total of 60 papers met inclusion criteria between 2016 and 2023. A series of practical questions in medical research are investigated. These include the sources of label noise, the impact of label noise, the detection of label noise, label noise handling techniques, and their evaluation. Categorization of both label noise detection methods and handling techniques are provided.

Discussion

From a methodological perspective, we observe that the medical community has been up to date with the broader deep-learning community, given that most techniques have been evaluated on medical data. We recommend considering label noise as a standard element in medical research, even if it is not dedicated to handling noisy labels. Initial experiments can start with easy-to-implement methods, such as noise-robust loss functions, weighting, and curriculum learning.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Deep LearningHumansBiomedical Research

Stichwörter der Autor:innen

deep learninglabel uncertaintynoisy label

Autor:innen und Institutionen

  • Department of Population Health Sciences, Weill Cornell Medicine, New York, NY 10065, United States.
  • Reddit Inc., San Francisco, CA 16093, United States.
  • Center for Health Information Partnerships, Northwestern University, Chicago, IL 10611, United States.
  • Department of Surgery, University of Minnesota, Minneapolis, MN 55455, United States.
  • Department of Statistics and Data Science, Northwestern University, Evanston, IL 60208, United States.

ORCID-Profile: Mingquan Lin, Yifan Peng

Förderung

  • NLM NIH HHS
  • National Science Foundation
  • National Library of Medicine

Zitieren

APA

Wei, Y., Deng, Y., Sun, C., Lin, M., Jiang, H., & Peng, Y. (2024). Deep learning with noisy labels in medical prediction problems: a scoping review. Journal of the American Medical Informatics Association, 31(7), 1596-1607. https://doi.org/10.1093/jamia/ocae108

Vancouver

Wei Y, Deng Y, Sun C, Lin M, Jiang H, Peng Y. Deep learning with noisy labels in medical prediction problems: a scoping review. Journal of the American Medical Informatics Association. 2024;31(7):1596-1607. doi:10.1093/jamia/ocae108

BibTeX
@article{Wei2024,
  author = {Wei, Yishu and Deng, Yu and Sun, Cong and Lin, Mingquan and Jiang, Hongmei and Peng, Yifan},
  title = {Deep learning with noisy labels in medical prediction problems: a scoping review},
  journal = {Journal of the American Medical Informatics Association},
  year = {2024},
  volume = {31},
  number = {7},
  pages = {1596--1607},
  doi = {10.1093/jamia/ocae108}
}
Kostenlos starten →