Navigating Data Corruption in Machine Learning: Balancing Quality, Quantity, and Imputation Strategies
Future Internet · 29.05.2025 · 17 (6) · 241
DOI: 10.3390/fi17060241 ↗Kurz gefasst
Fachartikel in der Zeitschrift Future Internet, online erschienen am 29.05.2025. Verfasst von Qi Liu und 1 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Shanghai Baiyulan Talent Project Pujiang Program, Shanghai Yangpu District Postdoctoral Innovation & Practice Base Project.
Abstract (Originalsprache)
Data corruption, including missing and noisy entries, is a common challenge in real-world machine learning. This paper examines its impact and mitigation strategies through two experimental setups: supervised NLP tasks (NLP-SL) and deep reinforcement learning for traffic signal control (Signal-RL). This study analyzes how varying corruption levels affect model performance, evaluate imputation strategies, and assess whether expanding datasets can counteract corruption effects. The results indicate that performance degradation follows a diminishing-return pattern, well modeled by an exponential function. Noisy data harm performance more than missing data, especially in sequential tasks like Signal-RL where errors may compound. Imputation helps recover missing data but can introduce noise, with its effectiveness depending on corruption severity and imputation accuracy. This study identifies clear boundaries between when imputation is beneficial versus harmful, and classifies tasks as either noise-sensitive or noise-insensitive. Larger datasets reduce corruption effects but offer diminishing gains at high corruption levels. These insights guide the design of robust systems, emphasizing smart data collection, imputation decisions, and preprocessing strategies in noisy environments.
Förderung
- Shanghai Baiyulan Talent Project Pujiang Program
- Shanghai Yangpu District Postdoctoral Innovation & Practice Base Project
Zitieren
APA
Liu, Q., & Ma, W. (2025). Navigating Data Corruption in Machine Learning: Balancing Quality, Quantity, and Imputation Strategies. Future Internet, 17(6), 241. https://doi.org/10.3390/fi17060241
Vancouver
Liu Q, Ma W. Navigating Data Corruption in Machine Learning: Balancing Quality, Quantity, and Imputation Strategies. Future Internet. 2025;17(6):241. doi:10.3390/fi17060241
BibTeX
@article{Liu2025,
author = {Liu, Qi and Ma, Wanjing},
title = {Navigating Data Corruption in Machine Learning: Balancing Quality, Quantity, and Imputation Strategies},
journal = {Future Internet},
year = {2025},
volume = {17},
number = {6},
pages = {241},
doi = {10.3390/fi17060241}
}
EUVIMED