EUVIMEDEUVIMED entdecken
Crossref

Distributed Learning Systems with First-Order Methods

Ji Liu, Ce Zhang

Foundations and Trends in Databases · 30.06.2020 · 9 (1) · 1-100

DOI: 10.1561/1900000062 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Foundations and Trends in Databases, online erschienen am 30.06.2020. Verfasst von Ji Liu und 1 weiteren Autor:innen. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 134 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Scalable and efficient distributed learning is one of the main driving forces behind the recent rapid advancement of machine learning and artificial intelligence. One prominent feature of this topic is that recent progress has been made by researchers in two communities: (1) the system community such as database, data management, and distributed systems, and (2) the machine learning and mathematical optimization community. The interaction and knowledge sharing between these two communities has led to the rapid development of new distributed learning systems and theory. In this monograph, we hope to provide a brief introduction of some distributed learning techniques that have recently been developed, namely lossy communication compression (e.g., quantization and sparsification), asynchronous communication, and decentralized communication. One special focus in this monograph is on making sure that it can be easily understood by researchers in both communities — on the system side, we rely on a simplified system model hiding many system details that are not necessary for the intuition behind the system speedups; while, on the theory side, we rely on minimal assumptions and significantly simplify the proof of some recent work to achieve comparable results.

Zitieren

APA

Liu, J., & Zhang, C. (2020). Distributed Learning Systems with First-Order Methods. Foundations and Trends in Databases, 9(1), 1-100. https://doi.org/10.1561/1900000062

Vancouver

Liu J, Zhang C. Distributed Learning Systems with First-Order Methods. Foundations and Trends in Databases. 2020;9(1):1-100. doi:10.1561/1900000062

BibTeX
@article{Liu2020,
  author = {Liu, Ji and Zhang, Ce},
  title = {Distributed Learning Systems with First-Order Methods},
  journal = {Foundations and Trends in Databases},
  year = {2020},
  volume = {9},
  number = {1},
  pages = {1--100},
  doi = {10.1561/1900000062}
}
Kostenlos starten →