Training neural networks on data sources with unknown reliability
Information Fusion · 2025-11 · 123 · 103239
DOI: 10.1016/j.inffus.2025.103239 ↗Kurz gefasst
Fachartikel in der Zeitschrift Information Fusion, 2025-11. Verfasst von Alexander Capstick und 3 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: UK Research and Innovation, National Institute for Health Research Imperial Biomedical Research Centre, UKRI Medical Research Council.
Abstract (Originalsprache)
When data is generated by multiple sources, conventional training methods update models assuming equal reliability for each source and do not consider their individual data quality. However, in many applications, sources have varied levels of reliability that can have negative effects on the performance of a neural network. A key issue is that often the quality of the data for individual sources is not known during training. Previous methods for training models in the presence of noisy data do not make use of the additional information that the source label can provide. Focusing on supervised learning, we aim to train neural networks on each data source for a number of steps proportional to the source's estimated reliability by using a dynamic re-weighting strategy motivated by likelihood tempering. This way, we allow training on all sources during the warm-up and reduce learning on less reliable sources during the final training stages, when it has been shown that models overfit to noise. We show through diverse experiments that this can significantly improve model performance when trained on mixtures of reliable and unreliable data sources, and maintain performance when models are trained on reliable sources only.
Förderung
- UK Research and Innovation
- National Institute for Health Research Imperial Biomedical Research Centre
- UKRI Medical Research Council
- Engineering and Physical Sciences Research Council
- Alzheimer’s Research UK
- Alzheimer's Society
- UK Dementia Research Institute
- Royal Academy of Engineering
Zitieren
APA
Capstick, A., Palermo, F., Cui, T., & Barnaghi, P. (2025). Training neural networks on data sources with unknown reliability. Information Fusion, 123, 103239. https://doi.org/10.1016/j.inffus.2025.103239
Vancouver
Capstick A, Palermo F, Cui T, Barnaghi P. Training neural networks on data sources with unknown reliability. Information Fusion. 2025;123:103239. doi:10.1016/j.inffus.2025.103239
BibTeX
@article{Capstick2025,
author = {Capstick, Alexander and Palermo, Francesca and Cui, Tianyu and Barnaghi, Payam},
title = {Training neural networks on data sources with unknown reliability},
journal = {Information Fusion},
year = {2025},
volume = {123},
pages = {103239},
doi = {10.1016/j.inffus.2025.103239}
}
EUVIMED