Deep learning with noisy labels in medical prediction problems: a scoping review
Journal of the American Medical Informatics Association · 20.06.2024 · 31 (7) · 1596-1607
DOI: 10.1093/jamia/ocae108 ↗Kurz gefasst
Scoping Review in der Zeitschrift Journal of the American Medical Informatics Association, online erschienen am 30.05.2024. Verfasst von Yishu Wei und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Population Health Sciences, Weill Cornell Medicine, New York, NY 10065, United States. Hauptthemen laut MEDLINE: Deep Learning. Die Arbeit wurde bisher 44-mal zitiert (Crossref) und nennt 84 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NLM NIH HHS, National Science Foundation, National Library of Medicine.
Abstract (Originalsprache)
Objectives
Medical research faces substantial challenges from noisy labels attributed to factors like inter-expert variability and machine-extracted labels. Despite this, the adoption of label noise management remains limited, and label noise is largely ignored. To this end, there is a critical need to conduct a scoping review focusing on the problem space. This scoping review aims to comprehensively review label noise management in deep learning-based medical prediction problems, which includes label noise detection, label noise handling, and evaluation. Research involving label uncertainty is also included.
Methods
Our scoping review follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. We searched 4 databases, including PubMed, IEEE Xplore, Google Scholar, and Semantic Scholar. Our search terms include “noisy label AND medical/healthcare/clinical,” “uncertainty AND medical/healthcare/clinical,” and “noise AND medical/healthcare/clinical.” Results A total of 60 papers met inclusion criteria between 2016 and 2023. A series of practical questions in medical research are investigated. These include the sources of label noise, the impact of label noise, the detection of label noise, label noise handling techniques, and their evaluation. Categorization of both label noise detection methods and handling techniques are provided.
Discussion
From a methodological perspective, we observe that the medical community has been up to date with the broader deep-learning community, given that most techniques have been evaluated on medical data. We recommend considering label noise as a standard element in medical research, even if it is not dedicated to handling noisy labels. Initial experiments can start with easy-to-implement methods, such as noise-robust loss functions, weighting, and curriculum learning.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Population Health Sciences, Weill Cornell Medicine, New York, NY 10065, United States.
- Reddit Inc., San Francisco, CA 16093, United States.
- Center for Health Information Partnerships, Northwestern University, Chicago, IL 10611, United States.
- Department of Surgery, University of Minnesota, Minneapolis, MN 55455, United States.
- Department of Statistics and Data Science, Northwestern University, Evanston, IL 60208, United States.
ORCID-Profile: Mingquan Lin, Yifan Peng
Förderung
- NLM NIH HHS
- National Science Foundation
- National Library of Medicine
Zitieren
APA
Wei, Y., Deng, Y., Sun, C., Lin, M., Jiang, H., & Peng, Y. (2024). Deep learning with noisy labels in medical prediction problems: a scoping review. Journal of the American Medical Informatics Association, 31(7), 1596-1607. https://doi.org/10.1093/jamia/ocae108
Vancouver
Wei Y, Deng Y, Sun C, Lin M, Jiang H, Peng Y. Deep learning with noisy labels in medical prediction problems: a scoping review. Journal of the American Medical Informatics Association. 2024;31(7):1596-1607. doi:10.1093/jamia/ocae108
BibTeX
@article{Wei2024,
author = {Wei, Yishu and Deng, Yu and Sun, Cong and Lin, Mingquan and Jiang, Hongmei and Peng, Yifan},
title = {Deep learning with noisy labels in medical prediction problems: a scoping review},
journal = {Journal of the American Medical Informatics Association},
year = {2024},
volume = {31},
number = {7},
pages = {1596--1607},
doi = {10.1093/jamia/ocae108}
}
EUVIMED