EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Navigating Data Corruption in Machine Learning: Balancing Quality, Quantity, and Imputation Strategies

Qi Liu, Wanjing Ma

Future Internet · 29.05.2025 · 17 (6) · 241

DOI: 10.3390/fi17060241 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Future Internet, online erschienen am 29.05.2025. Verfasst von Qi Liu und 1 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Shanghai Baiyulan Talent Project Pujiang Program, Shanghai Yangpu District Postdoctoral Innovation & Practice Base Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Data corruption, including missing and noisy entries, is a common challenge in real-world machine learning. This paper examines its impact and mitigation strategies through two experimental setups: supervised NLP tasks (NLP-SL) and deep reinforcement learning for traffic signal control (Signal-RL). This study analyzes how varying corruption levels affect model performance, evaluate imputation strategies, and assess whether expanding datasets can counteract corruption effects. The results indicate that performance degradation follows a diminishing-return pattern, well modeled by an exponential function. Noisy data harm performance more than missing data, especially in sequential tasks like Signal-RL where errors may compound. Imputation helps recover missing data but can introduce noise, with its effectiveness depending on corruption severity and imputation accuracy. This study identifies clear boundaries between when imputation is beneficial versus harmful, and classifies tasks as either noise-sensitive or noise-insensitive. Larger datasets reduce corruption effects but offer diminishing gains at high corruption levels. These insights guide the design of robust systems, emphasizing smart data collection, imputation decisions, and preprocessing strategies in noisy environments.

Förderung

  • Shanghai Baiyulan Talent Project Pujiang Program
  • Shanghai Yangpu District Postdoctoral Innovation & Practice Base Project

Zitieren

APA

Liu, Q., & Ma, W. (2025). Navigating Data Corruption in Machine Learning: Balancing Quality, Quantity, and Imputation Strategies. Future Internet, 17(6), 241. https://doi.org/10.3390/fi17060241

Vancouver

Liu Q, Ma W. Navigating Data Corruption in Machine Learning: Balancing Quality, Quantity, and Imputation Strategies. Future Internet. 2025;17(6):241. doi:10.3390/fi17060241

BibTeX
@article{Liu2025,
  author = {Liu, Qi and Ma, Wanjing},
  title = {Navigating Data Corruption in Machine Learning: Balancing Quality, Quantity, and Imputation Strategies},
  journal = {Future Internet},
  year = {2025},
  volume = {17},
  number = {6},
  pages = {241},
  doi = {10.3390/fi17060241}
}
Kostenlos starten →