A DISTRIBUTED OPTIMIZATION FRAMEWORK FOR SCALABLE BIG DATA ANALYTICS USING STOCHASTIC GRADIENT DESCENT
Global Journal of Advanced Engineering Technologies and Sciences · 30.07.2023 · 10 (7) · 1-7
DOI: 10.64149/gjaets.10.7.1-7 ↗Kurz gefasst
Fachartikel in der Zeitschrift Global Journal of Advanced Engineering Technologies and Sciences, online erschienen am 30.07.2023. Verfasst von Vijay Vaswani.
Abstract (Originalsprache)
The explosive data growth in volume, velocity, and variety of data in modern applications has made the old data processing paradigms obsolete, thus making mathematical frameworks for scalable analytics necessary. This paper proposes a distributed optimization algorithm that is based on an adaptive stochastic gradient descent (ASGD) algorithm designed for large-scale machine learning tasks. We provide mathematical formulation incorporating a communication-efficient consensus mechanism for solving the objective function using distributed workers nodes. The proposed method solves the most important problem of convergence speed and fault tolerance, which are the specific problems of heterogeneous cluster environments. We validate our approach using the TPC-DS benchmark dataset at the scale of 1TB, and provide a 23% reduction in training time and 15% increase in the convergence of the objective function in comparison to the standard synchronous SGD implementations. Our results therefore suggest that it is possible to optimise overall system throughput by (significantly) adaptive parameter tuning at node level without reducing model accuracy.
Zitieren
APA
Vaswani, V. (2023). A DISTRIBUTED OPTIMIZATION FRAMEWORK FOR SCALABLE BIG DATA ANALYTICS USING STOCHASTIC GRADIENT DESCENT. Global Journal of Advanced Engineering Technologies and Sciences, 10(7), 1-7. https://doi.org/10.64149/gjaets.10.7.1-7
Vancouver
Vaswani V. A DISTRIBUTED OPTIMIZATION FRAMEWORK FOR SCALABLE BIG DATA ANALYTICS USING STOCHASTIC GRADIENT DESCENT. Global Journal of Advanced Engineering Technologies and Sciences. 2023;10(7):1-7. doi:10.64149/gjaets.10.7.1-7
BibTeX
@article{Vaswani2023,
author = {Vaswani, Vijay},
title = {A DISTRIBUTED OPTIMIZATION FRAMEWORK FOR SCALABLE BIG DATA ANALYTICS USING STOCHASTIC GRADIENT DESCENT},
journal = {Global Journal of Advanced Engineering Technologies and Sciences},
year = {2023},
volume = {10},
number = {7},
pages = {1--7},
doi = {10.64149/gjaets.10.7.1-7}
}
EUVIMED