EUVIMEDScopri EUVIMED
Crossref

Tensor Networks for Dimensionality Reduction and Large-Scale Optimizations Part 2 Applications and Future Perspectives

Andrzej Cichocki, Anh-Huy Phan, Qibin Zhao, Namgil Lee, Ivan Oseledets, Masashi Sugiyama, Danilo Mandic

Foundations and Trends® in Machine Learning · 2017-05-30 · 9 (6) · 431-673

DOI: 10.1561/2200000067 ↗

At a glance

Journal article in Foundations and Trends® in Machine Learning, published online on 2017-05-30. Written by Andrzej Cichocki and 6 co-authors. Cited 180 times so far (Crossref); 283 references.

AbstractDati bibliograficiCiteRelated studies

Abstract (original language)

Part 2 of this monograph builds on the introduction to tensor networks and their operations presented in Part 1. It focuses on tensor network models for super-compressed higher-order representation of data/parameters and related cost functions, while providing an outline of their applications in machine learning and data analytics. A particular emphasis is on the tensor train (TT) and Hierarchical Tucker (HT) decompositions, and their physically meaningful interpretations which reflect the scalability of the tensor network approach. Through a graphical approach, we also elucidate how, by virtue of the underlying low-rank tensor approximations and sophisticated contractions of core tensors, tensor networks have the ability to perform distributed computations on otherwise prohibitively large volumes of data/parameters, thereby alleviating or even eliminating the curse of dimensionality. The usefulness of this concept is illustrated over a number of applied areas, including generalized regression and classification (support tensor machines, canonical correlation analysis, higher order partial least squares), generalized eigenvalue decomposition, Riemannian optimization, and in the optimization of deep neural networks. Part 1 and Part 2 of this work can be used either as stand-alone separate texts, or indeed as a conjoint comprehensive review of the exciting field of low-rank tensor networks and tensor decompositions.

Cite

APA

Cichocki, A., Phan, A., Zhao, Q., Lee, N., Oseledets, I., Sugiyama, M., & Mandic, D. (2017). Tensor Networks for Dimensionality Reduction and Large-Scale Optimizations Part 2 Applications and Future Perspectives. Foundations and Trends® in Machine Learning, 9(6), 431-673. https://doi.org/10.1561/2200000067

Vancouver

Cichocki A, Phan A, Zhao Q, Lee N, Oseledets I, Sugiyama M, et al. Tensor Networks for Dimensionality Reduction and Large-Scale Optimizations Part 2 Applications and Future Perspectives. Foundations and Trends® in Machine Learning. 2017;9(6):431-673. doi:10.1561/2200000067

BibTeX
@article{Cichocki2017,
  author = {Cichocki, Andrzej and Phan, Anh-Huy and Zhao, Qibin and Lee, Namgil and Oseledets, Ivan and Sugiyama, Masashi and Mandic, Danilo},
  title = {Tensor Networks for Dimensionality Reduction and Large-Scale Optimizations Part 2 Applications and Future Perspectives},
  journal = {Foundations and Trends® in Machine Learning},
  year = {2017},
  volume = {9},
  number = {6},
  pages = {431--673},
  doi = {10.1561/2200000067}
}
Start for free →