EUVIMEDEUVIMED entdecken
Crossref

Balancing Communication and Computation in Gradient Tracking Algorithms for Decentralized Optimization

Albert S. Berahas, Raghu Bollapragada, Shagun Gupta

Journal of Optimization Theory and Applications · 2024-12 · 203 (3) · 2954-2987

DOI: 10.1007/s10957-024-02554-8 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Optimization Theory and Applications, online erschienen am 21.10.2024. Verfasst von Albert S. Berahas und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 62 Literaturangaben. Gefördert von: National Science Foundation Graduate Research Fellowship Program, Office of Naval Research.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Gradient tracking methods have emerged as one of the most popular approaches for solving decentralized optimization problems over networks. In this setting, each node in the network has a portion of the global objective function, and the goal is to collectively optimize this function. At every iteration, gradient tracking methods perform two operations (steps): (1) compute local gradients, and (2) communicate information with local neighbors in the network. The complexity of these two steps varies across different applications. In this paper, we present a framework that unifies gradient tracking methods and is endowed with flexibility with respect to the number of communication and computation steps. We establish unified theoretical convergence results for the algorithmic framework with any composition of communication and computation steps, and quantify the improvements achieved as a result of this flexibility. The framework recovers the results of popular gradient tracking methods as special cases, and allows for a direct comparison of these methods. Finally, we illustrate the performance of the proposed methods on quadratic functions and binary classification problems.

Förderung

  • National Science Foundation Graduate Research Fellowship Program
  • Office of Naval Research

Zitieren

APA

Berahas, A. S., Bollapragada, R., & Gupta, S. (2024). Balancing Communication and Computation in Gradient Tracking Algorithms for Decentralized Optimization. Journal of Optimization Theory and Applications, 203(3), 2954-2987. https://doi.org/10.1007/s10957-024-02554-8

Vancouver

Berahas AS, Bollapragada R, Gupta S. Balancing Communication and Computation in Gradient Tracking Algorithms for Decentralized Optimization. Journal of Optimization Theory and Applications. 2024;203(3):2954-2987. doi:10.1007/s10957-024-02554-8

BibTeX
@article{Berahas2024,
  author = {Berahas, Albert S. and Bollapragada, Raghu and Gupta, Shagun},
  title = {Balancing Communication and Computation in Gradient Tracking Algorithms for Decentralized Optimization},
  journal = {Journal of Optimization Theory and Applications},
  year = {2024},
  volume = {203},
  number = {3},
  pages = {2954--2987},
  doi = {10.1007/s10957-024-02554-8}
}
Kostenlos starten →