Optimization of Scalable Machine Learning Pipelines for Big Data Analytics in Distributed Systems
Insights in Computer, Signals and Systems · 2023
DOI: 10.70088/r0a1xh16 ↗Kurz gefasst
Fachartikel in der Zeitschrift Insights in Computer, Signals and Systems, 2023. Verfasst von Tian Qi.
Abstract (Originalsprache)
This paper proposes an optimization approach for machine learning pipelines in distributed systems aimed at improving scalability and performance for big data analytics. The approach addresses key challenges such as data partitioning, load balancing, resource management, and fault tolerance. Experimental results demonstrate significant improvements in throughput, latency, scalability, and resource utilization, with up to a 43% increase in throughput and a 35% reduction in resource consumption. The optimized pipeline not only performs better under increasing dataset sizes and node counts but also exhibits enhanced fault tolerance and cost efficiency. This study contributes to advancing the efficiency and effectiveness of machine learning pipelines in distributed environments, offering valuable insights for large-scale data processing and analysis.
Zitieren
APA
Qi, T. (2023). Optimization of Scalable Machine Learning Pipelines for Big Data Analytics in Distributed Systems. Insights in Computer, Signals and Systems. https://doi.org/10.70088/r0a1xh16
Vancouver
Qi T. Optimization of Scalable Machine Learning Pipelines for Big Data Analytics in Distributed Systems. Insights in Computer, Signals and Systems. 2023. doi:10.70088/r0a1xh16
BibTeX
@article{Qi2023,
author = {Qi, Tian},
title = {Optimization of Scalable Machine Learning Pipelines for Big Data Analytics in Distributed Systems},
journal = {Insights in Computer, Signals and Systems},
year = {2023},
doi = {10.70088/r0a1xh16}
}
EUVIMED