Trends and Challenges in Data Cleaning for Large-Scale Systems: A Survey
International Journal of Global Innovations and Solutions · 2025
DOI: 10.63412/53kczv76 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Global Innovations and Solutions, 2025. Verfasst von Srikanth Kamatala und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Data cleaning is a critical process to maintain the integrity and usability of large-scale systems that process massive, diverse, and dynamic datasets. As the scale and complexity of data ecosystems grow, traditional cleaning techniques face limitations in addressing challenges such as data heterogeneity, real-time processing demands, and resource constraints. This paper presents a comprehensive survey of the latest trends and persistent challenges in data cleaning for large-scale systems. It examines advancements in automated and AI-driven methods, distributed and cloud-based cleaning frameworks, and real-time error detection techniques for streaming data. Additionally, the survey highlights domain-specific cleaning approaches in sectors like healthcare and finance, where data quality significantly impacts decision-making and operational efficiency. Key challenges, including scalability bottlenecks, the lack of standardized benchmarks, and ethical considerations, are discussed in detail. Finally, the paper identifies open research directions, such as explainable AI in data cleaning, universal metrics development, and sustainable algorithms for resource-efficient processing. By synthesizing recent developments and emphasizing their role in improving decision-making, system performance, and user experience, this survey aims to guide researchers and practitioners toward innovative solutions for enhancing data quality in large-scale systems.
Zitieren
APA
Kamatala, S., Jonnalagadda, A. K., & Myakala, P. K. (2025). Trends and Challenges in Data Cleaning for Large-Scale Systems: A Survey. International Journal of Global Innovations and Solutions. https://doi.org/10.63412/53kczv76
Vancouver
Kamatala S, Jonnalagadda AK, Myakala PK. Trends and Challenges in Data Cleaning for Large-Scale Systems: A Survey. International Journal of Global Innovations and Solutions. 2025. doi:10.63412/53kczv76
BibTeX
@article{Kamatala2025,
author = {Kamatala, Srikanth and Jonnalagadda, Anil Kumar and Myakala, Praveen Kumar},
title = {Trends and Challenges in Data Cleaning for Large-Scale Systems: A Survey},
journal = {International Journal of Global Innovations and Solutions},
year = {2025},
doi = {10.63412/53kczv76}
}
EUVIMED