Distributed Stochastic Projection-Free Algorithm for Constrained Optimization
IEEE Transactions on Automatic Control · 2025-04 · 70 (4) · 2479-2494
DOI: 10.1109/tac.2024.3481040 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Automatic Control, 2025-04. Verfasst von Xia Jiang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 56 Literaturangaben. Gefördert von: National Key R&D Program of China, National Natural Science Foundation of China, Natural Science Foundation of Chongqing.
Abstract (Originalsprache)
This article proposes a distributed stochastic projection-free algorithm for large-scale constrained finite-sum optimization whose constraint set is complicated such that the projection onto the constraint set can be expensive. The global cost function is allocated to multiple agents, each of which computes its local stochastic gradients and communicates with its neighbors to solve the global problem. Stochastic gradient methods enable low computational complexity, while they are hard and slow to converge due to the variance caused by random sampling. To construct a convergent distributed stochastic projection-free algorithm, this article incorporates variance reduction and gradient tracking techniques in the Frank–Wolfe (FW) update. We develop a novel sampling rule for the variance reduction technique to reduce the variance introduced by stochastic gradients. Complete and rigorous proofs show that the proposed distributed projection-free algorithm converges with a sublinear convergence rate and enjoys superior complexity guarantees for both convex and nonconvex objective functions. By comparative simulations, we demonstrate the convergence and computational efficiency of the proposed algorithm.
Förderung
- National Key R&D Program of China
- National Natural Science Foundation of China
- Natural Science Foundation of Chongqing
- China Scholarship Council
Zitieren
APA
Jiang, X., Zeng, X., Xie, L., Sun, J., & Chen, J. (2025). Distributed Stochastic Projection-Free Algorithm for Constrained Optimization. IEEE Transactions on Automatic Control, 70(4), 2479-2494. https://doi.org/10.1109/tac.2024.3481040
Vancouver
Jiang X, Zeng X, Xie L, Sun J, Chen J. Distributed Stochastic Projection-Free Algorithm for Constrained Optimization. IEEE Transactions on Automatic Control. 2025;70(4):2479-2494. doi:10.1109/tac.2024.3481040
BibTeX
@article{Jiang2025,
author = {Jiang, Xia and Zeng, Xianlin and Xie, Lihua and Sun, Jian and Chen, Jie},
title = {Distributed Stochastic Projection-Free Algorithm for Constrained Optimization},
journal = {IEEE Transactions on Automatic Control},
year = {2025},
volume = {70},
number = {4},
pages = {2479--2494},
doi = {10.1109/tac.2024.3481040}
}
EUVIMED